Senior AWS Data Engineer - Lakehouse & Spark Pipelines

Technopride Ltd; Greater London; On-site; GBP 75,000 - 95,000; Full time

Job summary

A leading tech solutions provider in London is seeking an experienced Senior Data Engineer to help shape the architecture of a next-generation data platform. Responsibilities include designing scalable data pipelines, implementing ETL processes, and orchestrating workflows using AWS. The ideal candidate will have over 10 years of experience in engineering and a strong background in cloud-native technologies. Competitive compensation and a collaborative work environment offered.

Qualifications

• 10+ years of hands-on engineering experience required.
• Experience writing clean, maintainable code using modern practices.
• Solid understanding of data pipelines and ETL processes.

Responsibilities

• Design and develop scalable, testable data pipelines using Python.
• Implement batch workflows and ETL processes per modern standards.
• Orchestrate data workflows using AWS services.
• Build monitoring and observability into data flows.

Skills

Python programming

Data engineering fundamentals

Apache Spark

AWS services (S3, Glue, Lambda)

Agile environment experience

Tools

Apache Spark

AWS Glue

CI/CD tools

Job description

A leading tech solutions provider in London is seeking an experienced Senior Data Engineer to help shape the architecture of a next-generation data platform. Responsibilities include designing scalable data pipelines, implementing ETL processes, and orchestrating workflows using AWS. The ideal candidate will have over 10 years of experience in engineering and a strong background in cloud-native technologies. Competitive compensation and a collaborative work environment offered.