Data Engineering Lead — AWS Platform & Architecture

Fairmont Recruitment Technology; Greater London; On-site; GBP 90,000 - 130,000; Full time

Job summary

Fairmont Recruitment Technology is seeking a Data Engineering Lead to provide senior technical leadership across a large-scale AWS data platform for a major organisation. This role blends hands-on engineering with team leadership, platform ownership and architectural decision-making.

You will mentor engineers, define engineering standards, collaborate with architecture, security and QA teams, and help translate business requirements into scalable data solutions while driving DataOps practices

Qualifications

• Advanced SQL skills and optimisation across very large datasets.
• Experience building batch and streaming data pipelines.
• Knowledge of data warehouses, data lakes and modern storage patterns.
• Experience with Spark or similar distributed processing tech.
• Strong CI/CD, DevOps and DataOps practices.
• Setting engineering standards and improving code quality.
• Previous technical leadership or mentoring experience.
• Strong stakeholder management and communication skills.
• Experience with large-scale data and complex operational environments.
• Experience integrating legacy systems, fixed-width files and REST APIs.
• Experience working with external technology and delivery partners.

Responsibilities

• Lead the development, operation and improvement of the AWS data platform.
• Oversee delivery of complex batch and streaming data pipelines.
• Make architectural decisions around data models, storage and tooling.
• Improve platform resilience, scalability, performance and availability.
• Set standards across coding, testing, monitoring, documentation and DataOps.
• Mentor and support data engineers at different levels.
• Act as the senior escalation point for complex data engineering issues.
• Work with Architecture, Information Security and QA teams.
• Collaborate with external partners on integrations and platform development.
• Translate business requirements into practical technical solutions.
• Prioritise engineering work and support the organisation’s data strategy.
• Ensure operational controls and monitoring are in place.

Skills

Advanced SQL

Batch processing

Streaming data pipelines

Data warehouses

Data lakes

Spark

CI/CD

DevOps

DataOps

Coding standards

Mentoring

Stakeholder management

Large datasets

Operational environments

Legacy integrations

REST APIs

Partner collaboration

Education

Tools

AWS Redshift

Amazon S3

AWS Glue

AWS Lambda

EC2

Kinesis Firehose

Python

SQL

Bash

Job description

Fairmont Recruitment Technology is seeking a Data Engineering Lead to provide senior technical leadership across a large-scale AWS data platform for a major organisation. This role blends hands-on engineering with team leadership, platform ownership and architectural decision-making.

You will mentor engineers, define engineering standards, collaborate with architecture, security and QA teams, and help translate business requirements into scalable data solutions while driving DataOps practices