Senior Data Engineer: Cloud Data Pipelines & Leadership

Department for Work and Pensions (DWP)

United States

Hybrid

USD 60.000 - 101.000

Vollzeit

Vor 2 Tagen

Sei unter den ersten Bewerbenden

Eine vollständige Bewerbung in einer Minute

Maßgeschneiderter Lebenslauf und Anschreiben – versandbereit.

Schaffe es an den ATS-Filtern vorbei

Benefits dieser Stelle

Flexible hours

Volunteer time off

I Can Be Me

Discounts

Season-ticket loan

Sports & social

Career development

Zusammenfassung

Department for Work and Pensions (DWP) is seeking a Senior Data Engineer to lead the design and delivery of modern cloud-based data solutions. You will design and optimize ETL/ELT pipelines, work with stakeholders to convert complex requirements into trusted data assets, and drive best practices across the data platform team.

You will guide technically, collaborate across DWP Digital’s areas, and help shape architecture while delivering value with Agile methods.

Qualifikationen

Proven experience designing and delivering complex ETL/ELT pipelines.
Communicate complex technical concepts clearly to technical and non-technical audiences, including senior stakeholders.
Strong understanding of cloud and distributed data processing for scalable, maintainable solutions.
Proven ability to analyse complex requirements and define testing approaches.
Experience migrating data from legacy/on-premise systems to cloud platforms.

Aufgaben

Lead the design and delivery of cloud-based data solutions.
Design, build and enhance scalable ETL/ELT pipelines using Python and PySpark.
Transform data into trusted datasets to enable insights and decision-making.
Lead teams through large-scale data and platform transformations.
Champion Agile delivery, data governance and operational excellence.

Kenntnisse

ETL/ELT pipelines

Stakeholder communication

Cloud data processing

Requirements analysis

Issue resolution

Data migration

PySpark

Tools

Azure

Spark SQL

Jobbeschreibung