Data Engineer

Anson McCade; Greater London; Hybrid; GBP 45,000 - 105,000; Full time

Benefits offered by this job

Private healthcare

25 days annual leave

Pension

Annual bonus

Share ownership

Training and certifications

Job summary

Anson McCade is seeking a Data Engineer with active DV clearance to join a UK-wide programme spanning Defence, Government and National Security. You’ll design production pipelines in AWS, work across the full data lifecycle, and collaborate with cross-functional teams.

The role offers diverse projects across London, Manchester, Bristol and Edinburgh, with hybrid working and strong opportunities for progression, training and certifications, plus a competitive benefits package.

Qualifications

• Experience designing and deploying Production data pipelines in a big data environment.
• Strong experience with AWS cloud technologies and data engineering services.
• Hands-on experience with Python, Java, Scala, Spark and SQL.

Responsibilities

• Design and build production-grade data pipelines and data solutions within AWS environments.
• Work across the full data lifecycle from ingestion to consumption.
• Build and optimise data solutions using AWS services like Glue, EMR, Redshift, Kinesis, Lambda and DynamoDB.
• Work with large volumes of structured and unstructured data from multiple sources.
• Develop data solutions using Python, Java, Scala, Spark and SQL.
• Write scripts, APIs and SQL queries, contributing to scalable cloud data platforms.
• Collaborate with clients and cross-functional teams to deliver high-quality outcomes.
• Follow Agile practices and contribute to solution design and continuous improvement.

Skills

Production data pipelines

AWS cloud technologies

Python

Java

Scala

Spark

SQL

Data ingestion and integration

Analytical problem solving

Stakeholder collaboration

Tools

AWS Glue

EMR

Redshift

Kinesis

Lambda

DynamoDB

Job description

Data Engineer – Active DV Clearance Required

UK-wide: London | Manchester | Bristol | Edinburgh

We’re working with a leading technology and consulting organisation that is growing its Digital & Data capability across Defence, Government, National Security and other highly regulated sectors.

They are looking for Data Engineers at multiple levels to join teams delivering complex, high-impact data solutions for a range of clients.

Please note: Active DV clearance is essential for these positions.

Who you’ll be working with

You’ll join a collaborative community of Data Engineers, Software Engineers, Architects, Consultants and other technical specialists, working on challenging projects where data plays a critical role in solving complex problems.

You’ll have the opportunity to work across different projects, technologies and sectors, with plenty of scope to develop your technical skills and progress your career.

What you’ll be doing

• Design and build production-grade data pipelines and data solutions within AWS environments.
• Work across the full data lifecycle, from ingestion and processing through to transformation, storage and consumption.
• Build and optimise data solutions using AWS services such as Glue, EMR, Redshift, Kinesis, Lambda and DynamoDB.
• Work with large volumes of structured and unstructured data, integrating information from multiple sources.
• Develop data solutions using technologies including Python, Java, Scala, Spark and SQL.
• Write scripts, develop APIs and SQL queries, and contribute to the design and deployment of scalable cloud-based data platforms.
• Work closely with clients and cross-functional teams to understand requirements, solve technical problems and deliver high-quality outcomes.
• Follow Agile engineering practices and contribute to technical discussions, solution design and continuous improvement.

What we’re looking for

• Experience designing and deploying production data pipelines within a big data environment.
• Strong experience with AWS cloud technologies and data engineering services.
• Hands-on experience with one or more of Python, Java, Scala, Spark and SQL.
• Experience working with large-scale structured and unstructured datasets.
• Understanding of data ingestion, processing, transformation and integration.
• Strong analytical and problem-solving skills.
• Comfortable working collaboratively with technical and non-technical stakeholders.

What’s in it for you

• £45,000 – £105,000 depending on level and experience.
• Multiple opportunities across different seniority levels.
• UK-wide opportunities with hybrid working arrangements.
• Work on technically challenging projects across Defence, Government and National Security.
• Access to training, professional development and technical certifications.
• Supportive technical community with opportunities for mentoring and progression.
• Competitive benefits package including private healthcare, 25 days’ annual leave, pension, annual bonus and share ownership.