Data Engineer – DV Cleared

Anson McCade; Greater London; Hybrid; GBP 81,000 - 99,000; Full time

Benefits offered by this job

Hybrid work model

Active DV clearance required

Job summary

Anson McCade is recruiting two Associate Manager Data Engineers to design, build and optimise scalable data pipelines across AWS/Azure/GCP. You will tackle complex data challenges and drive delivery within Agile teams.

Ideal candidates have deep data engineering experience, strong Python and SQL skills, and the ability to lead technical decisions while collaborating with clients on high-profile programmes. This role is London-based with hybrid 3 days on-site and requires Active DV clearance.

Qualifications

• Extensive data engineering experience on modern data platforms.
• Strong Python and SQL proficiency.
• Experience with AWS/Azure/GCP and data warehousing/lake architectures.
• Hands-on with Docker/Kubernetes and CI/CD practices.
• Ability to lead teams and mentor colleagues.

Responsibilities

• Design, develop and improve scalable data pipelines.
• Build ETL/ELT pipelines (batch and streaming).
• Work with large-scale datasets and data platforms.
• Apply cloud platforms AWS/Azure/GCP to ecosystems.
• Lead technical decisions and mentor team members.

Skills

Python

Cloud platforms

Data pipelines

SQL

Spark

Kinesis

CI/CD

TDD

Version control

Data modelling

IaC

Terraform

CloudFormation

Leadership

Stakeholder comms

Tools

Docker

Kubernetes

Terraform

CloudFormation

Job description

Location: London / Outer London (hybrid - 3 days on-site)

Salary: Up to £90,000 London / £83,000 Outer London

Clearance: Active DV Clearance required

We are supporting a leading technology and consulting organisation in the appointment of two Associate Manager Data Engineers to work on high-profile, technically complex programmes. This is an excellent opportunity for experienced Data Engineers who enjoy working across modern data platforms, solving complex technical challenges and taking ownership of delivery within collaborative engineering teams.

The Role

You will be responsible for designing, developing and improving scalable data solutions, working across data engineering, cloud technologies and modern software engineering practices. You will have the opportunity to work with large-scale datasets and contribute to the development of robust data platforms and pipelines.

Key responsibilities include:

• Designing, developing and re-engineering scalable, robust and repeatable data pipelines
• Building and orchestrating ETL/ELT pipelines using both batch and streaming technologies
• Working with large-scale datasets and developing efficient data transformation processes
• Defining and maintaining data mappings in line with data modelling principles
• Building data structures, metadata, dependencies and workload management processes
• Identifying and resolving data quality, mapping, database and application issues
• Connecting operational systems with analytics and business intelligence platforms
• Developing and maintaining high-quality production code, documentation and automated testing
• Working with cloud-based data platforms across AWS, Azure or GCP
• Contributing to the deployment and monitoring of machine learning models where required
• Working within Agile/Scrum teams and contributing to sprint planning, delivery and technical discussions
• Providing technical leadership, supporting team members and contributing to key technical decisions
• Working closely with stakeholders to understand requirements and translate them into effective technical solutions

Key Skills & Experience

• Strong commercial experience in Data Engineering
• Strong proficiency in Python
• Extensive experience working with AWS, Azure or GCP
• Experience with data warehousing and data lake architectures
• Strong SQL experience, with exposure to NoSQL databases
• Experience with distributed computing technologies such as Spark or Kinesis
• Understanding of software engineering best practices including CI/CD, TDD and version control
• Experience with Docker and/or Kubernetes
• Experience with Infrastructure as Code, ideally Terraform or CloudFormation
• Strong understanding of data modelling and system architecture
• Experience working on AI/ML projects would be advantageous
• Previous experience providing technical leadership, mentoring or making technical decisions
• Strong communication skills, with the ability to explain complex technical concepts to both technical and non-technical stakeholders
• Experience working directly with clients or external partners

Security Clearance

Due to the nature of the programmes, active DV clearance is essential for these positions. Candidates must be able to maintain the required level of UK security clearance.

If you are an experienced Data Engineer looking for a senior opportunity where you can combine hands-on engineering with technical leadership and work on complex, high-impact programmes, we would be keen to hear from you.