Senior Data Engineer: Build Scalable Data Pipelines

Johnson Matthey; Wendy; On-site; GBP 48,000 - 60,000; Full time

Job summary

A government agency is seeking a Senior Data Engineer to develop data pipelines and improve data access across the organisation. You will lead the development of data-engineering solutions and collaborate with teams to support strategic decision-making. The ideal candidate should have experience with large-scale analytics engines, cloud data stacks, and strong communication skills. A competitive salary up to £60,800 plus comprehensive benefits is offered.

Benefits

29% employer pension contribution

Annual leave of 28.5 days plus 8 public holidays

Personalised training and development plans

Flexible working hours

Social and sports clubs

Qualifications

• Experience with large-scale analytics engines and scripting languages.
• Hands-on use of cloud data stacks and modern storage formats.
• Experience with DevOps and testing data pipelines.

Responsibilities

• Identify opportunities to optimise data flows and manage databases.
• Lead development of data-engineering solutions and advise teams.
• Collaborate with colleagues to understand data engineering's value.

Skills

Large-scale analytics engines (e.g. Spark/PySpark)

Scripting languages (Python or Scala)

Cloud data stacks (e.g. SageMaker Notebooks, S3, Glue, Athena)

DevOps/DataOps tooling (e.g. Terraform)

Strong communication skills

Experience profiling data

Tools

IBM DB2/QREP

BMC Control-M

Talend Data Integration

Job description

A government agency is seeking a Senior Data Engineer to develop data pipelines and improve data access across the organisation. You will lead the development of data-engineering solutions and collaborate with teams to support strategic decision-making. The ideal candidate should have experience with large-scale analytics engines, cloud data stacks, and strong communication skills. A competitive salary up to £60,800 plus comprehensive benefits is offered.