Senior AWS Data Engineer: Scalable Pipelines & Lakehouse

Technopride Ltd; City Of London; On-site; GBP 70,000 - 90,000; Full time

Job summary

A leading data solutions firm is seeking an experienced Senior Data Engineer to develop next-generation data pipelines. In this role, you will design scalable workflows using Python and AWS services, apply software engineering best practices, and collaborate with stakeholders to create data-driven solutions. The ideal candidate will have over 10 years of experience and a solid understanding of data engineering fundamentals. This is an exciting opportunity to be part of a fast-paced, innovative environment.

Qualifications

• 10+ years of hands-on engineering experience.
• Strong background in building modern data pipelines.
• Experience with cloud-native technologies.
• Familiarity with data quality frameworks.

Responsibilities

• Design and develop scalable, testable data pipelines.
• Orchestrate data workflows using AWS services.
• Participate in code reviews and architectural design.

Skills

Python coding

Data pipeline development

AWS services (Glue, Lambda, EMR)

Apache Spark

Agile environments

Tools

Apache Spark

AWS S3

GitLab CI

Jenkins

Job description

A leading data solutions firm is seeking an experienced Senior Data Engineer to develop next-generation data pipelines. In this role, you will design scalable workflows using Python and AWS services, apply software engineering best practices, and collaborate with stakeholders to create data-driven solutions. The ideal candidate will have over 10 years of experience and a solid understanding of data engineering fundamentals. This is an exciting opportunity to be part of a fast-paced, innovative environment.