Senior Data Engineer | Cloud Pipelines & Hybrid Work

Jacobs; Greater London; Hybrid; GBP 65,000 - 90,000; Full time

Benefits offered by this job

Flexible working arrangements

Mentorship & development opportunities

Competitive benefits package

Pension and holiday allowance

Global opportunities and collaboration

Job summary

Jacobs is expanding its Data & Digital team in the UK, growing data engineering capabilities across government, defence and regulated environments. You will design, build and maintain modern cloud data platforms, unlocking data value for informed decision making and supporting critical services.

Join a collaborative team of engineers and architects, leveraging AWS and Azure services, PySpark and SQL, with a flexible hybrid working model and opportunities for professional development and

Qualifications

• Experience designing and building ETL/ELT pipelines in cloud environments (AWS/Azure).
• Proficiency with PySpark, Python and SQL for data processing and analytics.
• Hands-on experience with data integration components and microservices in Java.
• Familiarity with Git, CI/CD and Agile delivery practices.

Responsibilities

• Design, build and maintain reliable ETL/ELT data pipelines using AWS or Azure cloud-native services.
• Develop and support data integration components and services, including Java-based microservices.
• Prepare, transform and validate structured and semi-structured data (parquet, avro, JSON).
• Write efficient SQL to query and optimize data across Athena, Redshift and Synapse.
• Build scalable data processing solutions using PySpark and Python in cloud orchestrations.
• Implement data quality checks, monitoring and logging for trusted data delivery.
• Support tuning and optimization of pipelines, SQL workloads and integration services.
• Collaborate with data architects, analysts and stakeholders to deliver high-quality solutions.
• Participate in DevOps ways of working with source control, automated testing and CI/CD.

Skills

PySpark

SQL

Python

Java

Git

CI/CD

Agile delivery

Tools

AWS Glue

Lambda

Step Functions

Azure Data Factory

Synapse

Azure Functions

Logic Apps

AWS S3

Azure Data Lake Storage Gen2

Job description

Jacobs is expanding its Data & Digital team in the UK, growing data engineering capabilities across government, defence and regulated environments. You will design, build and maintain modern cloud data platforms, unlocking data value for informed decision making and supporting critical services.

Join a collaborative team of engineers and architects, leveraging AWS and Azure services, PySpark and SQL, with a flexible hybrid working model and opportunities for professional development and