Cloud Data Engineer — ETL Pipelines & PySpark

Jacobs; Lancashire; Hybrid; GBP 55,000 - 85,000; Full time

Benefits offered by this job

Flexible working practices

Pension scheme

Career development & mentoring

Hybrid work model

Job summary

Jacobs is seeking a Data Engineer to help grow our Data & Digital capability across government, defence and regulated environments. You will design, build and maintain modern data platforms, unlocking data value to support informed decisions and critical services.

You’ll work alongside engineers, architects and stakeholders, contributing to scalable ETL/ELT pipelines, cloud-native services and data quality initiatives while advancing your skills on meaningful projects across multiple sectors.

Qualifications

• Experience designing and maintaining ETL/ELT data pipelines.
• Strong knowledge of cloud data platforms (AWS/Azure) and data lake/storage services.
• Proficiency with SQL and programming languages (Python/Java).
• Hands-on experience with CI/CD and DevOps practices in data projects.

Responsibilities

• Design, build and maintain reliable ETL/ELT data pipelines using AWS or Azure cloud-native services and established engineering patterns
• Develop and support data integration components and services, including Java-based microservices where required
• Prepare, transform and validate structured and semi-structured data, including formats such as parquet, avro and JSON
• Write efficient SQL to query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse
• Build scalable data processing solutions using PySpark, Python and cloud-native orchestration services
• Implement data quality checks, validation processes, monitoring and logging to ensure trusted and reliable data delivery
• Support the performance tuning and optimisation of data pipelines, SQL workloads and integration services
• Work with AWS services such as S3, Glue, Lambda, Athena and Step Functions, or Azure equivalents including Data Lake Storage Gen2, Data Factory, Synapse, Azure Functions and Logic Apps
• Contribute to documentation, runbooks, data dictionaries and reusable engineering assets that support delivery teams
• Collaborate with data architects, analysts, software engineers and client stakeholders to deliver high-quality solutions
• Support DevOps ways of working through source control, automated testing and CI/CD practices
• Communicate progress, risks and technical decisions effectively with both technical and non-technical stakeholders

Skills

ETL/ELT pipelines

AWS

Azure

PySpark

SQL

Python

Java

CI/CD

Tools

S3

Glue

Data Factory

Synapse

Athena

Redshift

Job description

Jacobs is seeking a Data Engineer to help grow our Data & Digital capability across government, defence and regulated environments. You will design, build and maintain modern data platforms, unlocking data value to support informed decisions and critical services.

You’ll work alongside engineers, architects and stakeholders, contributing to scalable ETL/ELT pipelines, cloud-native services and data quality initiatives while advancing your skills on meaningful projects across multiple sectors.