Senior Data Engineer: Build Cloud Data Platforms & Impact

Jacobs; Glasgow; Hybrid; GBP 55,000 - 80,000; Full time

Benefits offered by this job

Global network of expertise

Flexible working arrangements

Mentoring & development opportunities

Pension and holiday allowance

Inclusive environment

Community of practice participation

Competitive benefits package

Job summary

Jacobs in the United Kingdom is seeking a data engineer to design, build and maintain cloud-based data platforms across AWS and Azure, collaborating with engineers, architects and client stakeholders. You will develop ETL/ELT pipelines, apply data quality checks, and contribute to documentation, runbooks and reusable assets while following CI/CD and Agile practices.

You will work on varied projects across government, defence and highly regulated industries, helping unlock data value and enable

Qualifications

• Design, build and maintain reliable ETL/ELT data pipelines using cloud services (AWS/Azure).
• Develop and support data integration components and services, including Java-based microservices where required.
• Prepare, transform and validate structured and semi-structured data (parquet, avro, JSON).
• Write efficient SQL to query data across cloud analytical platforms (Athena, Redshift, Azure Synapse SQL).
• Build scalable data processing solutions with PySpark and cloud orchestration services.
• Implement data quality checks, validation and monitoring for trusted data delivery.
• Support performance tuning of data pipelines, SQL workloads and integration services.
• Collaborate with data architects, analysts, software engineers and client stakeholders; follow CI/CD and Agile practices.

Responsibilities

• Design, build and maintain reliable ETL/ELT data pipelines using AWS or Azure cloud-native services and established engineering patterns
• Develop and support data integration components and services, including Java-based microservices where required
• Prepare, transform and validate structured and semi-structured data, including formats such as parquet, avro and JSON
• Write efficient SQL to query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse
• Build scalable data processing solutions using PySpark, Python and cloud-native orchestration services
• Implement data quality checks, validation processes, monitoring and logging to ensure trusted and reliable data delivery
• Support the performance tuning and optimisation of data pipelines, SQL workloads and integration services
• Work with AWS services such as S3, Glue, Lambda, Athena and Step Functions, or Azure equivalents including Data Lake Storage Gen2, Data Factory, Synapse, Azure Functions and Logic Apps
• Contribute to documentation, runbooks, data dictionaries and reusable engineering assets that support delivery teams
• Collaborate with data architects, analysts, software engineers and client stakeholders to deliver high-quality solutions
• Support DevOps ways of working through source control, automated testing and CI/CD practices
• Communicate progress, risks and technical decisions effectively with both technical and non-technical stakeholders

Skills

PySpark

SQL

Python

Java

Data integration

Git / CI/CD

Agile delivery

Data quality

Tools

AWS Glue

AWS Lambda

AWS Step Functions

Azure Data Factory

Azure Synapse

Azure Functions

Logic Apps

AWS S3

Data Lake Storage Gen2

Job description

Jacobs in the United Kingdom is seeking a data engineer to design, build and maintain cloud-based data platforms across AWS and Azure, collaborating with engineers, architects and client stakeholders. You will develop ETL/ELT pipelines, apply data quality checks, and contribute to documentation, runbooks and reusable assets while following CI/CD and Agile practices.

You will work on varied projects across government, defence and highly regulated industries, helping unlock data value and enable