Senior Data Engineer (AWS, Airflow, Python)

Triad; England; Hybrid; GBP 55,000 - 65,000; Full time

Job summary

A leading consultancy firm in the UK is seeking a Senior Data Engineer to deliver high-quality data solutions. In this role, you will design, build, and optimize cloud-based data platforms primarily using AWS. Responsibilities include developing scalable data pipelines, collaborating with multidisciplinary teams, and contributing to data-driven outcomes. You will have opportunities to influence technical decisions and enhance data architecture. The position offers a supportive culture with various benefits, including professional development and competitive salary.

Benefits

25 days annual leave plus bank holidays

Matched pension contributions (5%)

Private healthcare

Gym membership support

Cycle-to-work scheme

Perkbox membership

Qualifications

• Strong experience with cloud data platforms, particularly AWS.
• Excellent ETL and data transformation skills.
• Advanced proficiency in SQL and Python.

Responsibilities

• Design and develop scalable data pipelines in AWS.
• Create and manage data models for efficient storage and retrieval.
• Collaborate with teams on data requirements and integration.

Skills

Data pipeline design

ETL processes

SQL (PostgreSQL)

Python

AWS services (S3, EC2, etc.)

Apache Airflow

Terraform

Collaboration

Education

Degree in Computer Science, Data Science, or related

Tools

AWS

Apache Airflow

Terraform

Job description

Senior Data Engineer (AWS, Airflow, Python)

Based at client locations, working remotely, or based in our Godalming or Milton Keynes offices. Salary up to £65k plus company benefits.

About Us

Triad Group Plc is an award‑winning digital, data, and solutions consultancy with over 35 years' experience primarily serving the UK public sector and central government. We deliver high‑quality solutions that make a real difference to users, citizens and consumers.

At Triad, collaboration thrives, knowledge is shared, and every voice matters. Our close‑knit, supportive culture ensures you're valued from day one. Whether working with cutting‑edge technology or shaping strategy for national‑scale projects, you'll be trusted, challenged, and empowered to grow.

We nurture learning through communities of practice and encourage creativity, autonomy, and innovation. If you're passionate about solving meaningful problems with smart and passionate people, Triad could be the place for you.

Glassdoor score of 4.7

96% of our staff would recommend Triad to a friend

100% CEO approval

See for yourself some of the work that makes us all so proud:

• Helping law enforcement with secure intelligence systems that keep the UK safe
• Supporting the UK's national meteorological service in leveraging supercomputers for next‑level weather forecasting
• Assisting a UK government department responsible for consumer product safety with systems to track unsafe products
• Powering systems that help the government monitor and reduce greenhouse gas emissions from commercial transport

Role Summary

Triad is seeking a Senior Data Engineer to play a key role in delivering high‑quality data solutions across a range of client assignments, primarily within the UK public sector. You will design, build, and optimise cloud‑based data platforms, working closely with multidisciplinary teams to understand data requirements and deliver scalable, reliable, and secure data pipelines. This role offers the opportunity to shape data architecture, influence technical decisions, and contribute to meaningful, data‑driven outcomes.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines to extract, transform, and load (ETL) data into cloud‑based data platforms, primarily AWS.
• Create and manage data models that support efficient storage, retrieval, and analysis of data.
• Utilise AWS services such as S3, EC2, Glue, Aurora, Redshift, DynamoDB and Lambda to architect and maintain cloud data solutions.
• Maintain modular Terraform‑based IaC for reliable provisioning of AWS infrastructure.
• Develop, optimise and maintain robust data pipelines using Apache Airflow.
• Implement data transformation processes using Python to clean, preprocess, and enrich data for analytical use.
• Collaborate with data analysts, data scientists, developers, and other stakeholders to understand and integrate data requirements.
• Monitor, optimise, and tune data pipelines to ensure performance, reliability, and scalability.
• Identify data quality issues and implement data validation and cleansing processes.
• Maintain clear and comprehensive documentation covering data pipelines, models, and best practices.
• Work within a continuous integration environment with automated builds, deployments, and testing.

Skills and Experience

• Strong experience designing and building data pipelines on cloud platforms, particularly AWS.
• Excellent proficiency in developing ETL processes and data transformation workflows.
• Strong SQL skills (PostgreSQL) and advanced Python coding capability (essential).
• Experience working with AWS services such as S3, EC2, Glue, Aurora, Redshift, DynamoDB and Lambda (essential).
• Understanding of Terraform codebases to create and manage AWS infrastructure.
• Experience developing, optimising, and maintaining data pipelines using Apache Airflow.
• Familiarity with distributed data processing systems such as Spark or Databricks.
• Experience working with high‑performing, low‑latency, or large‑volume data systems.
• Ability to collaborate effectively within cross‑functional, agile, delivery‑focused teams.
• Experience defining data models, metadata, and data dictionaries to ensure consistency and accuracy.

Qualifications & Certifications

• A degree or equivalent qualification in Computer Science, Data Science, or a related discipline (desirable).
• Due to the nature of this position, you must be willing and eligible to achieve a minimum of SC clearance. To be eligible, you must have been a resident in the UK for a minimum of 5 years and have the right to work in the UK.

Triad's Commitment to You

• Continuous Training & Development: Access to top‑rated Udemy Business courses.
• Work Environment: Collaborative, creative, and free from discrimination.

Benefits

• 25 days of annual leave, plus bank holidays.
• Matched pension contributions (5%).
• Private healthcare with Bupa.
• Gym membership support or Lakeshore Fitness access.
• Perkbox membership.
• Cycle‑to‑work scheme.

What Our Colleagues Have to Say

Please see for yourself on Glassdoor and our "Day in the Life" videos at the bottom of our Careers Page.

Our Selection Process

After applying for the role, our in‑house talent team will contact you to discuss Triad and the position. If shortlisted, you will be invited for:

1. A technical test including numerical, logical and verbal reasoning
2. A technical interview with our consultants
3. A management interview to assess cultural fit

We aim to complete interviews and progress candidates to offer stage within 2‑3 weeks of the initial conversation.

Other Information

If this role is of interest to you or you would like further information, please contact Ryan Jordanand submit your application now.

Triad is an equal opportunities employer and welcomes applications from all suitably qualified people regardless of sex, race, disability, age, sexual orientation, gender reassignment, religion or belief. We are proud that our recruitment process is inclusive and accessible to disabled people who meet the minimum criteria for any role. Triad is a signatory to the Tech Talent Charter and a Disability Confident Leader.