Senior Data Engineer

Made Tech; Swansea; On-site; GBP 50,000 - 70,000; Full time

Job summary

A leading tech consultancy is looking for a Senior Data Engineer to enable public sector organizations to embrace a data-driven approach. You will provide hands-on support, mentor junior engineers, and help define growth opportunities. Candidates must have significant experience with Git, Infrastructure as Code, and cloud management, alongside a strong understanding of modern data architectures. Additionally, eligibility for SC security clearance is required, necessitating at least 5 years of UK residency.

Qualifications

• Experience mentoring junior engineers and upskilling teams is essential.
• Must be proficient in creating efficient data pipelines on cloud platforms.
• A minimum of 5 years UK residency for SC clearance is required.

Responsibilities

• Provide hands-on support for project delivery as a senior contributor.
• Upskill client team members and mentor junior engineers.
• Act as a technical architect to identify growth opportunities.

Skills

Enthusiasm for learning and self‑development

Proficiency in Git (including GitHub Actions)

Experience gathering requirements on data projects

Strong experience in Infrastructure as Code

Managing cloud infrastructure with a DevOps approach

Handling various data types using Apache Spark or Hadoop

Understanding modern data system architectures

Creating data pipelines with error handling

Documenting data processing system diagrams

Implementing DevOps practices in data projects

Enhancing resilience through vulnerability checks

Applying SOLID, DRY and TDD principles

Agile methodologies such as Scrum, XP and Kanban

Designing efficient data transformations at scale

Commercial mindset for account growth

Eligibility for SC security clearance

Tools

Docker

Apache Spark

Databricks

Hadoop

Job description

Overview

Our Senior Data Engineers enable public sector organisations to embrace a data‑driven approach by providing high‑quality, cost‑efficient data platforms and services tailored to clients’ needs. They develop, operate, and maintain these platforms, ensuring maximum value for data consumers, including analysts, scientists and business stakeholders. As a Senior Data Engineer you may assume multiple roles based on our clients’ needs; the role is highly hands‑on, supporting project delivery as a senior contributor, upskilling client team members and potentially acting as a technical architect alongside the MadeTech team to identify growth opportunities within the account. You will need a drive to deliver outcomes for users, considering the broader context of delivery and maintaining alignment between operational and analytical aspects of the engineering solution.

Responsibilities

• Provide hands‑on support for project delivery as a senior contributor.
• Upskill client team members and mentor junior engineers.
• Act as a technical architect in collaboration with the MadeTech team to identify and pursue growth opportunities within the account.

Qualifications

• Enthusiasm for learning and self‑development
• Proficiency in Git (including GitHub Actions) and understanding of branch strategies
• Experience gathering and meeting requirements from clients and users on data projects
• Strong experience in Infrastructure as Code (IaC) and deploying infrastructure across environments
• Managing cloud infrastructure with a DevOps approach
• Handling and transforming various data types (JSON, CSV, etc.) using Apache Spark, Databricks or Hadoop
• Understanding modern data system architectures (Data Warehouse, Data Lakes, Data Meshes) and their use cases
• Creating data pipelines on cloud platforms with error handling and reusable libraries
• Documenting and presenting end‑to‑end data processing system diagrams (C4, UML, etc.)
• Implementing robust DevOps practices in data projects, including DataOps tools for orchestration, data integration, and analytics
• Enhancing resilience through vulnerability checks and testing strategies (unit, integration, data quality)
• Applying SOLID, DRY and TDD principles practically
• Agile methodologies such as Scrum, XP and Kanban
• Designing and implementing efficient batch and streaming data transformations at scale
• Mentoring, team support and line management skills
• Commercial mindset to grow accounts organically with senior stakeholders
• Eligibility for SC security clearance, requiring at least 5 years of UK residency; if eligibility is not confirmed we cannot consider your application.

Desired Skills

• Working in a technology consultancy
• Using Docker and virtual environments in CI/CD
• Engaging with senior stakeholders for requirements gathering
• Collaborating with engineers via pair or mob programming
• Working with data scientists to productionise machine learning models
• Knowledge of statistics
• Collaborating across multidisciplinary teams
• Experience within the public sector