Senior AWS Data Engineer — Data Platform & ETL Leader

UBDS Group; Greater London; On-site; GBP 70,000 - 110,000; Full time

Benefits offered by this job

Private medical cover

Discretionary bonus

Holiday – 25 days + birthday + work-周年

EV leasing

Pension scheme

Death in service cover

Job summary

UBDS Group seeks an experienced Senior Data Engineer to design, build and deliver scalable data platforms within AWS. You’ll mentor engineers, guide patterns, and collaborate with architects and security professionals to ensure secure, resilient data solutions for clients in regulated environments.

You’ll lead data ingestion, transformation and governance efforts, leveraging S3/Glue/Lambda/Redshift and related AWS services, while applying CI/CD and IaC practices to deployments.

Qualifications

• Significant hands‑on experience as a Data Engineer, ideally within complex enterprise environments
• Strong experience designing and delivering data solutions on AWS
• Strong Python and SQL skills
• Experience with infrastructure‑as‑code, ideally Terraform
• Experience with CI/CD and automated testing for data engineering workloads
• Good understanding of data security, governance, access control and data quality
• Current SC clearance is highly desirable due to the nature and timescales of our client engagements

Responsibilities

• Design, build and maintain scalable data platforms and data pipelines within AWS
• Develop robust ETL/ELT processes for ingesting, transforming and processing data from multiple sources
• Design and implement data solutions using AWS services such as S3, Glue, Lambda, Athena, Redshift, EMR and related technologies
• Design data models and storage approaches appropriate to analytical and operational requirements
• Develop solutions using Python, SQL and modern data engineering frameworks
• Apply infrastructure‑as‑code and automation approaches to the deployment and management of data platforms
• Build data quality, validation, monitoring and observability into engineering solutions
• Ensure security, governance and data protection requirements are considered throughout solution design and delivery
• Work with architects, cloud engineers, security specialists and other SMEs to ensure solutions integrate effectively across the wider technology landscape
• Engage with clients and technical stakeholders to understand requirements, explain technical decisions and provide recommendations
• Troubleshoot complex data, performance and integration issues across development and production environments
• Define and promote data engineering standards, reusable patterns and best practices
• Mentor and support other engineers, encouraging knowledge sharing and continuous improvement

Skills

Python

SQL

Data modeling

CI/CD

Data governance

Security

Tools

Terraform

AWS S3

AWS Glue

AWS Lambda

AWS Athena

AWS Redshift

AWS EMR

Job description

UBDS Group seeks an experienced Senior Data Engineer to design, build and deliver scalable data platforms within AWS. You’ll mentor engineers, guide patterns, and collaborate with architects and security professionals to ensure secure, resilient data solutions for clients in regulated environments.

You’ll lead data ingestion, transformation and governance efforts, leveraging S3/Glue/Lambda/Redshift and related AWS services, while applying CI/CD and IaC practices to deployments.