Senior Data Engineer - Azure Pipelines & Cloud Data | Hybrid

DWP Digital; West End; Ibrido; GBP 68.000 - 76.000; Tempo pieno

Vantaggi offerti da questo lavoro

Hybrid working

Flexible hours

Pension contributions

Career development

Life balance

Descrizione del lavoro

DWP Digital in the United Kingdom is seeking an experienced Senior Data Engineer with strong Azure skills to lead data pipelines and technical teams. You will design and deliver modern cloud-based data solutions, ensure trusted, high-quality data for decision making, and help evolve engineering standards while mentoring colleagues in a hybrid environment.

Join a dedicated Data Engineering community across multiple locations, with flexible hours and a generous pension, working to improve services

Competenze

• Proven experience designing and delivering complex ETL/ELT pipelines.
• Ability to communicate complex technical concepts to varied audiences.
• Strong knowledge of cloud and distributed data processing.
• Experience leading resolution of complex data and pipeline issues.
• Experience migrating data from on-premise to cloud platforms.

Mansioni

• Design, build and enhance scalable ETL/ELT pipelines using Python and PySpark.
• Transform data into trusted, high-quality datasets for insights.
• Manage and optimise data across multiple platforms, ensuring security.
• Lead teams through large-scale data transformations and set engineering direction.

Conoscenze

ETL pipelines

PySpark

Spark SQL

Azure

Data architecture

Descrizione del lavoro

DWP Digital in the United Kingdom is seeking an experienced Senior Data Engineer with strong Azure skills to lead data pipelines and technical teams. You will design and deliver modern cloud-based data solutions, ensure trusted, high-quality data for decision making, and help evolve engineering standards while mentoring colleagues in a hybrid environment.

Join a dedicated Data Engineering community across multiple locations, with flexible hours and a generous pension, working to improve services