Senior Data Engineer: Cloud Data Platforms & Pipelines

Jacobs; Lancashire; Hybrid; GBP 90,000 - 120,000; Full time

Benefits offered by this job

Flexible working arrangements

Hybrid working policy

Mentoring & development opportunities

Pension

Job summary

Jacobs is seeking a Senior Data Engineer to grow our Data & Digital capability, designing and maintaining modern data platforms for government, defence and regulated industries. You will work with cloud-native services, Java/Python, and PySpark to deliver reliable data solutions and collaborate with cross-functional teams.

You’ll contribute to documentation, runbooks and engineering assets while supporting DevOps and CI/CD practices in a hybrid working environment across the UK.

Qualifications

• Experience designing and building data pipelines in cloud environments.
• Hands-on with AWS/Azure data services and Java microservices.
• Proven ability to transform and validate structured/semi-structured data.

Responsibilities

• Design, build and maintain ETL/ELT pipelines using AWS or Azure.
• Develop data integration components including Java microservices.
• Prepare, transform and validate parquet, avro and JSON data.
• Write SQL to query data on Athena, Redshift or Azure Synapse.
• Build data processing with PySpark and cloud orchestration.
• Implement data quality checks, monitoring and logging.
• Tune performance of pipelines and SQL workloads.
• Work with S3, Glue, Lambda, Athena or Data Factory, Synapse and related services.
• Contribute to runbooks, data dictionaries and assets.
• Collaborate with data architects, analysts and stakeholders.
• Support DevOps with source control, CI/CD and automated tests.
• Communicate progress and risks to technical and non-technical audiences.

Skills

PySpark

SQL

Python/Java

ETL/ELT data pipeline development

Data quality, validation and монитор링

Git

CI/CD

Agile delivery practices

Lead/Senior role in project

SC clearance eligibility

Tools

AWS Glue

Lambda

Step Functions

Azure Data Factory

Synapse

Azure Functions

Logic Apps

S3

Data Lake Storage Gen2

Job description

Jacobs is seeking a Senior Data Engineer to grow our Data & Digital capability, designing and maintaining modern data platforms for government, defence and regulated industries. You will work with cloud-native services, Java/Python, and PySpark to deliver reliable data solutions and collaborate with cross-functional teams.

You’ll contribute to documentation, runbooks and engineering assets while supporting DevOps and CI/CD practices in a hybrid working environment across the UK.