Cloud Data Engineer — ETL, PySpark & Cloud Pipelines

Jacobs; Gloucester; Hybrid; GBP 55,000 - 85,000; Full time

Job summary

Jacobs in the United Kingdom is seeking a Data Engineer to help grow our data and digital capabilities across government, defence and regulated industries. You will design, build and maintain modern data platforms that unlock value from data and support decision making, working with engineers, architects and client stakeholders on meaningful projects.

You'll gain hands-on experience with AWS and Azure cloud services, PySpark, SQL, and CI/CD practices, while contributing to documentation and

Qualifications

• Experience designing and maintaining ETL/ELT pipelines in cloud environments.
• Proficient in SQL and data modeling for cloud analytics platforms.
• Knowledge of CI/CD practices and DevOps for data platforms.

Responsibilities

• Design, build and maintain ETL/ELT data pipelines using AWS or Azure cloud-native services.
• Develop data integration components and services, including Java-based microservices where required.
• Prepare, transform and validate structured and semi-structured data (parquet, avro, JSON).
• Write efficient SQL to query, validate and optimise data across cloud analytics platforms.
• Build scalable data processing solutions using PySpark and Python.
• Implement data quality checks, validation processes, monitoring and logging.
• Collaborate with data architects, analysts, software engineers and client stakeholders.
• Support DevOps through source control, automated testing and CI/CD practices.

Skills

ETL/ELT pipelines

Cloud data platforms

PySpark

Python

SQL

AWS

Azure

Data quality

CI/CD

Documentation

Tools

AWS

Azure

S3

Glue

Lambda

Athena

Redshift

Azure Synapse

Data Factory

Data Lake Storage Gen2

Git

CI/CD

Job description

Jacobs in the United Kingdom is seeking a Data Engineer to help grow our data and digital capabilities across government, defence and regulated industries. You will design, build and maintain modern data platforms that unlock value from data and support decision making, working with engineers, architects and client stakeholders on meaningful projects.

You'll gain hands-on experience with AWS and Azure cloud services, PySpark, SQL, and CI/CD practices, while contributing to documentation and