Cloud Data Engineer — ETL, PySpark & AWS/Azure

Jacobs; Greater London; Hybrid; GBP 65,000 - 90,000; Full time

Benefits offered by this job

Flexible working

Mentoring and development

Pension and holidays

Job summary

Jacobs Data & Digital team is expanding its data engineering capability across government, defence and regulated industries in the UK. This role designs, builds and maintains modern data platforms to unlock data value and enable better decision-making.

You will work with AWS and Azure, PySpark, SQL and data integration components, collaborating with engineers, analysts and client stakeholders to deliver high-quality, scalable solutions.

Qualifications

• Experience designing, building and maintaining ETL/ELT pipelines in cloud environments.
• Proficiency with SQL and data modeling for cloud analytics platforms.
• Experience with PySpark, Python and Java in data engineering contexts.
• Experience with AWS or Azure data services and microservices is a plus.
• Knowledge of data quality, validation and monitoring practices.

Responsibilities

• Design, build and maintain ETL/ELT data pipelines using AWS or Azure cloud services.
• Develop and support data integration components, including Java-based microservices.
• Prepare, transform and validate structured and semi-structured data (parquet, avro, JSON).
• Write efficient SQL to query and optimize data on Athena, Redshift and Synapse.
• Build scalable data processing solutions with PySpark and cloud orchestration.
• Implement data quality checks, monitoring and logging for trusted data delivery.
• Support performance tuning of data pipelines and SQL workloads.
• Collaborate with data architects, analysts, engineers and client stakeholders.
• Contribute to documentation, runbooks, data dictionaries and reusable assets.
• Support DevOps practices with source control, testing and CI/CD.

Skills

ETL/ELT pipelines

SQL

PySpark

Python

AWS

Azure

Data quality

CI/CD

Git

Big data concepts

Tools

AWS

Azure

S3

Data Factory

Synapse

Glue

Lambda

Step Functions

Parquet/Avro/JSON

Job description

Jacobs Data & Digital team is expanding its data engineering capability across government, defence and regulated industries in the UK. This role designs, builds and maintains modern data platforms to unlock data value and enable better decision-making.

You will work with AWS and Azure, PySpark, SQL and data integration components, collaborating with engineers, analysts and client stakeholders to deliver high-quality, scalable solutions.