Data Engineer

Money & Pensions Service; Bedford; Hybrid; GBP 48,000 - 60,000; Full time

Benefits offered by this job

30 days annual leave

Pension scheme matched

Cycle to work

Eye tests & flu jabs

Life assurance

Employee assistance program

Season ticket loan

Give as you earn

Job summary

Money and Pensions Service in Bedford is hiring a Data Engineer to design and implement data pipelines that connect operational systems and support BI in a cloud-only environment, primarily Microsoft Fabric on Azure.

You will work with senior engineers, develop our data architecture, and contribute to data governance and quality while delivering reliable Data Products for users across the UK.

Qualifications

• Experience designing and implementing ETL pipelines in Azure/MS Fabric environments.
• Strong SQL skills and data manipulation capabilities.
• Experience with cloud data tooling and data governance.

Responsibilities

• Design and implement data pipelines to connect systems and support analytics and BI.
• Collaborate with data scientists and analysts to meet data needs.
• Develop and maintain cloud-based data platforms and BI readiness.

Skills

SQL

Azure Data Factory

Spark / PySpark

Python

Microsoft Fabric / Synapse

Data modeling

ETL design

Power BI

Tools

Azure Synapse Analytics

Microsoft Fabric

Power BI

Apache Spark

Job description

Data Engineer

c. £53,000 per annum

Bedford Based

Hybrid Working

Permanent

Join us at the Money and Pensions Service (MaPS) as a Data Engineer where you will design and implement data pipelines to connect operational systems, engineering data for analytics and business intelligence (BI) systems in a cloud-only environment, predominantly Microsoft Fabric on Azure.

This role offers the opportunity to work with Senior Engineers on cloud-based data engineering pipelines and be part of developing our technical data architecture and platform.

We're especially interested in candidates who can show how their technical work has solved real business problems or improved outcomes for users, not just a list of technical skills.

The Data Engineer reports to the Senior Data Engineer. The role is aligned to the Government Digital and Data Profession Capability Framework: Data Engineer: https://ddat-capability-framework.service.gov.uk/role/data-engineer#data-engineer

You’ll be part of a dynamic team dedicated to helping people across the UK improve their financial wellbeing.

Key Responsibilities:

Data Pipelines and ETL Processes

• ETL Implementation: Implement ETL processes within MaPS architectural patterns to extract, transform, and load data from various source systems into our reporting solutions.
• Pipeline Development: Develop and configure meta-data driven data pipelines using data orchestration tools such as Azure Data factory and engineering tools like Apache Spark to ensure seamless data flow.
• Monitoring and Failure Recovery: Implement monitoring procedures to detect failures or unusual data profiles and establish recovery processes to maintain data integrity.

Azure Services

• Utilise Cloud based data technology platforms, Data Lake based storage & Cloud data pipeline/orchestration tools for efficient data storage, processing, and transfer.
• Ensure the scalability and reliability of data solutions using Azure's suite of services.

Collaboration

• Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet their needs.
• Working within Agile methodology, helping to build clear user stories and work items.

Data Governance and Quality

• Ensure data governance policies are adhered to and maintain high standards of data quality and security.
• Develop pipelines using best practices for data management and integration.
• Ensure only thoroughly tested, high-quality code and resulting Data Products are delivered to the MaPS business.

Data Landscape

• Broad understanding & interest of architectural principles underlying modern data architecture. E.g. Data Lakes, External tables, medallion architecture, loose coupling.
• Reporting & analysis tooling. A high-level understanding of report tooling such as Power BI & the needs of analysts consuming engineered data into these tools.

You will need to demonstrate the following skills and experience.

• Data Engineering experience, able to work independently following established patterns.
• Experience implementing ETL processes ideally in an Azure/MS Fabric environment.
• Experience and genuine competence in using SQL to query and manipulate data.
• Proficiency in cloud data tooling such as Synapse Analytics, Microsoft Fabric, Azure Data Factory or AWS equivalents.
• Spark/Pyspark or Python skills.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.
• MS Fabric interest, skills or experience a bonus.
• Willingness to learn and a genuine enthusiasm for cloud technology and data.

About Us
The Money and Pensions Service (MaPS) is based in Bedford, in a recently renovated modern office. This is a wonderful opportunity for you to become an integral part of a dynamic organisation, working to help people across the UK.

At the heart of the Money and Pensions Service are our values – caring, connecting, and transforming, which are the foundation of our success. They permeate every area of our work and define all our business relationships and the way we work with each other. We're not only looking for the best people to come and work for us, but we need people who align themselves with our values:

• Caring
  We care about our colleagues and the people whose lives we are here to transform.
• Connecting
  We will transform lives through our ability to make positive connections.
• Transforming
  We are committed to transforming lives and making a positive societal impact.

Our Inclusive Working Environment
By fostering our values, we are immensely proud of the inclusive working environment that we have created. The diversity of our people is a strength that we embrace and wish to build upon, so we are committed to attracting people of all backgrounds. We work hard to ensure that we have a progressive approach to inclusion, equity, and belonging. We really do want our colleagues to "bring their whole selves to work."

Our colleague and ally networks encompass LGBTQ+, neurodiversity, women's health, men's health, ethnicity, and diversity.

What We Offer

This role will offer the opportunity to develop your career in a Cloud only environment with a high level of technical freedom, working with other highly technical and skilled engineers as well as benefits below:

• Generous Annual Leave - 30 days plus Bank Holidays
• Pension scheme - contributions matched 2 to 1 (up to 10% of your salary)
• Interest-free loan for season tickets for buses and trains
• Cycle to work Scheme
• Subsidised eye tests & flu jabs
• Life assurance scheme
• Give as you earn scheme
• Employee assistance programme (EAP)
• PAM Assist and PAM