Senior Data Engineer

Job Description

Role purpose: We're hiring a Senior Data Engineer to deliver high-quality data solutions across a range of business demands, building and maintaining pipelines, datasets, and data services that are reliable, secure, and easy to consume. This is a hands-on engineering role.

Key responsibilities:

• Build and maintain batch and/or streaming data pipelines end-to-end: ingest, transform, validate, and publish.
  
• Develop reusable data transformation patterns and curated datasets for analytics and operational use cases.
  
• Work from requirements through to production delivery: design, build, test, deploy, and support.
  
• Implement data quality checks, reconciliations, and monitoring/alerting to keep data trustworthy.
  
• Optimize performance and cost through query tuning, partitioning, and efficient computer usage.
  
• Maintain clear documentation, data definitions, and runbook for supported pipelines.
  
• Troubleshoot production issues, perform root cause analysis, and implement permanent fixes.
  
• Collaborate with upstream/downstream teams to resolve data issues and improve interfaces/contracts.
  
• Follow security and governance expectations for sensitive data, access controls, and audibility.
  

Requirements

Required skills and experience:

• Minimum 8 years of strong hands-on experience delivering data engineering solutions.
  
• Strong programming skills in Python and/or Java, experience with advanced SQL, and solid data modelling skills.
  
• Experience with distributed processing, e.g. Spark, and orchestration, e.g. Airflow or equivalent.
  
• Experience with streaming/event platforms, e.g. Kafka/PubSub, is beneficial; ability to learn quickly if not.
  
• Strong engineering discipline: Git, code reviews, automated testing, CI/CD, and observability.
  
• Experience working with cloud data platforms: Azure/AWS/GCP and lake/lake-house/warehouse patterns.
  
• Proven ability to manage multiple data requests and priorities effectively and deliver at pace.
  

Requirements

Role purpose: We're hiring a Senior Data Engineer to deliver high-quality data solutions across a range of business demands, building and maintaining pipelines, datasets, and data services that are reliable, secure, and easy to consume. This is a hands-on engineering role.

Key responsibilities:

• Build and maintain batch and/or streaming data pipelines end-to-end: ingest, transform, validate, and publish.
  
• Develop reusable data transformation patterns and curated datasets for analytics and operational use cases.
  
• Work from requirements through to production delivery: design, build, test, deploy, and support.
  
• Implement data quality checks, reconciliations, and monitoring/alerting to keep data trustworthy.
  
• Optimize performance and cost through query tuning, partitioning, and efficient computer usage.
  
• Maintain clear documentation, data definitions, and runbook for supported pipelines.
  
• Troubleshoot production issues, perform root cause analysis, and implement permanent fixes.
  
• Collaborate with upstream/downstream teams to resolve data issues and improve interfaces/contracts.
  
• Follow security and governance expectations for sensitive data, access controls, and audibility.
  

Requirements

Required skills and experience:

• Minimum 8 years of strong hands-on experience delivering data engineering solutions.
  
• Strong programming skills in Python and/or Java, experience with advanced SQL, and solid data modelling skills.
  
• Experience with distributed processing, e.g. Spark, and orchestration, e.g. Airflow or equivalent.
  
• Experience with streaming/event platforms, e.g. Kafka/PubSub, is beneficial; ability to learn quickly if not.
  
• Strong engineering discipline: Git, code reviews, automated testing, CI/CD, and observability.
  
• Experience working with cloud data platforms: Azure/AWS/GCP and lake/lake-house/warehouse patterns.
  
• Proven ability to manage multiple data requests and priorities effectively and deliver at pace.