DV-Cleared Data Engineer: Cloud Data Pipelines

Anson McCade; England; Hybrid; GBP 45,000 - 103,000; Full time

Benefits offered by this job

Hybrid working

Technical development and training

Career progression

Job summary

Anson McCade is partnering with a leading technology and consulting organisation to grow its Data Engineering capability across the UK. Roles range from junior to senior levels, with active DV clearance and hybrid UK-wide opportunities on complex national programmes.

You’ll design, build and improve data platforms and pipelines using AWS (Glue, EMR, Redshift, Kinesis, Lambda, DynamoDB) and languages like Python, Java, Scala and Spark, working with data lakes and warehouses in regulated

Qualifications

• Experience as a Data Engineer or closely related data role.
• Experience with AWS or equivalent cloud technologies.
• Strong SQL and programming skills.
• Proficient in Python, Java, Scala and/or Spark.
• Experience with large-scale structured and unstructured data.
• Understanding of data lakes, data warehouses and modern data architectures.
• API integration and data ingestion experience.
• Active DV clearance is essential.

Responsibilities

• Designing, building and improving data platforms and pipelines for complex client environments.
• Design production-grade data pipelines across ingestion, transformation, processing and consumption.
• Build data solutions within AWS cloud environments.
• Work with data lakes, warehouses and big data architectures.
• Integrate structured and unstructured data from multiple sources.
• Develop ETL and data movement solutions.
• Work with Python, Java, Scala, Spark; use APIs and scripting to extract/transform data.
• Collaborate with architects, engineers and client stakeholders and contribute to data strategy.

Skills

Data engineering

AWS

SQL

Python

Java

Scala

Spark

APIs

Data lakes

Tools

Glue

EMR

Redshift

Kinesis

Lambda

DynamoDB

Job description

Anson McCade is partnering with a leading technology and consulting organisation to grow its Data Engineering capability across the UK. Roles range from junior to senior levels, with active DV clearance and hybrid UK-wide opportunities on complex national programmes.

You’ll design, build and improve data platforms and pipelines using AWS (Glue, EMR, Redshift, Kinesis, Lambda, DynamoDB) and languages like Python, Java, Scala and Spark, working with data lakes and warehouses in regulated