Senior Data Engineer: Cloud Data Platforms & ETL

Jacobs Engineering Group Inc.; Manchester; Hybrid; GBP 60,000 - 90,000; Full time

Benefits offered by this job

Pension

Holiday allowance

Additional perks

Job summary

You will work with AWS and Azure, PySpark, SQL, and data integration services, collaborating with engineers, architects and stakeholders to deliver high-quality solutions.

The role offers hybrid working, continuous learning, and opportunities to contribute to diverse, regulated environments across government and defence.

Qualifications

• Experience designing and building data pipelines (ETL/ELT).
• Hands-on with cloud data platforms (AWS/Azure).
• Knowledge of structured and unstructured data formats.
• Experience with SQL querying on cloud analytics platforms.
• Collaborative work with engineers, architects, analysts and stakeholders.

Responsibilities

• Design, build and maintain ETL/ELT pipelines in AWS or Azure.
• Develop and support data integration components and microservices.
• Transform and validate data in formats like parquet, Avro and JSON.
• Write SQL for data validation and optimization on cloud analytics platforms.
• Create scalable data processing solutions using PySpark and Python.
• Implement data quality checks, monitoring and logging for trusted data.
• Support tuning of data pipelines and SQL workloads.
• Collaborate with data architects, analysts and client stakeholders.

Tools

AWS

Azure

S3

Glue

Lambda

Athena

Step Functions

Data Lake Storage Gen2

Data Factory

Synapse

Azure Functions

Logic Apps

PySpark

SQL

Python

Job description

You will work with AWS and Azure, PySpark, SQL, and data integration services, collaborating with engineers, architects and stakeholders to deliver high-quality solutions.

The role offers hybrid working, continuous learning, and opportunities to contribute to diverse, regulated environments across government and defence.