Data Engineer: Build Scalable Cloud Data Platforms

Jacobs; West of England; Hybrid; GBP 60,000 - 90,000; Full time

Benefits offered by this job

Flexible working arrangements

Mentoring and development programs

Competitive pension and benefits

Job summary

Jacobs is seeking a data engineer to design, build and maintain modern, cloud-native data platforms across AWS and Azure. You’ll develop ETL/ELT pipelines, implement data quality checks and work with PySpark, SQL and Java microservices to deliver trusted data for critical government and industry projects.

You will collaborate with data architects, analysts and engineers in multidisciplinary teams, applying CI/CD practices and DevOps ways of working to ensure robust, scalable solutions across

Qualifications

• Experience designing and building cloud-native data pipelines across AWS/Azure environments.
• Ability to develop and support data integration components and Java-based microservices when needed.
• Proficiency in transforming/validating structured and semi-structured data (parquet, avro, JSON).
• Strong SQL skills for querying data on cloud analytics platforms (Athena, Redshift, Azure Synapse SQL).
• Experience with PySpark and cloud orchestration services.
• Knowledge of data quality, validation, monitoring and logging.

Responsibilities

• Design, build and maintain reliable ETL/ELT pipelines using AWS or Azure cloud-native services and established engineering patterns.
• Develop and support data integration components and services, including Java-based microservices where required.
• Prepare, transform and validate structured and semi-structured data (parquet, avro, JSON).
• Write efficient SQL to query and optimise data on cloud analytics platforms (Athena, Redshift, Azure Synapse).
• Build scalable data processing solutions using PySpark, Python and cloud orchestration services.
• Implement data quality checks and monitoring to ensure trusted data delivery.

Skills

AWS Glue

Azure Data Factory

Synapse

SQL

Python

Java

ETL/ELT pipelines

Data quality & monitoring

Git & CI/CD

SC Clearance eligibility

PySpark

AWS S3 / Azure Data Lake Gen2

Tools

AWS

Azure

Parquet/Avro/JSON

Athena/Redshift/Azure Synapse SQL

Job description

Jacobs is seeking a data engineer to design, build and maintain modern, cloud-native data platforms across AWS and Azure. You’ll develop ETL/ELT pipelines, implement data quality checks and work with PySpark, SQL and Java microservices to deliver trusted data for critical government and industry projects.

You will collaborate with data architects, analysts and engineers in multidisciplinary teams, applying CI/CD practices and DevOps ways of working to ensure robust, scalable solutions across