Principal Data Engineer - AWS

Capco; City Of London; Hybrid; GBP 80,000 - 100,000; Full time

Job summary

A leading technology consulting firm is seeking a Principal Data Engineer specializing in AWS to design and deploy cloud-based data pipelines for Tier 1 financial clients. The role involves building end-to-end data solutions and mentoring junior engineers, in a hybrid work environment with a focus on innovative data transformation.

Benefits

Discretionary bonus

Health insurance

Gympass

Continuous learning opportunities

Family-friendly policies

Qualifications

• Proficient in one of Python, Scala, or Java.
• Strong experience in Big Data technologies such as Spark and Hadoop.
• Practical knowledge of building real-time event streaming pipelines.

Responsibilities

• Design and build end-to-end data pipelines leveraging AWS-native tools.
• Collaborate with clients to gather requirements and deliver solutions.
• Lead in developing robust data engineering solutions.

Skills

Python

Scala

Java

Big Data technologies

AWS cloud environments

Kafka

DevOps

Job description

Principal Data Engineer - AWS
Location: London (Hybrid) | Practice Area: Technology & Engineering | Type: Permanent

Engineer future-ready data platforms that power financial transformation.

The Role
We’re looking for a Principal Data Engineer with AWS to join our growing team of engineering experts driving next-gen transformation for Tier 1 financial services clients. You’ll play a pivotal role in designing, building, and deploying cloud-based data pipelines. Working across greenfield projects and enterprise-scale platforms, your work will directly impact the way data is ingested, transformed, and served at scale across the financial services industry.

What You’ll Do

Design and build end-to-end data pipelines leveraging AWS-native tools and modern data architectures.

Collaborate with clients to gather requirements, define solutions, and deliver production-grade systems.

Apply AWS Well-Architected Principles to ensure scalability, security, and resilience.

Lead in the development of robust, tested, and fault-tolerant data engineering solutions.

Support and mentor junior engineers, contributing to knowledge sharing across the team.

What We’re Looking For

Proficient in one of Python, Scala or Java, with strong experience in Big Data technologies such as: Spark, Hadoop etc.

Practical knowledge of building real-time event streaming pipelines (e.g., Kafka, Spark Streaming, Kinesis).

• Proficiency in AWS cloud environments.
• Proven experience developing modern data architectures including Data Lakehouse and Data Warehousing.
• A solid understanding of CI/CD practices, DevOps tooling, and data governance including GDPR.

Bonus Points For

Expertise in Data Modelling, schema design, and handling both structured and semi-structured data.

Familiarity with distributed systems such as Hadoop, Spark, HDFS, Hive, Databricks.

Exposure to AWS Lake Formation and automation of ingestion and transformation layers.

Background in delivering solutions for highly regulated industries.

Passion for mentoring and enabling data engineering best practices across teams.

Why Join Capco

Deliver high-impact technology solutions for Tier 1 financial institutions

Work in a collaborative, flat, and entrepreneurial consulting culture

Access continuous learning, training, and industry certifications

Be part of a team shaping the future of digital financial services

Help shape the future of digital transformation across FS & Energy

We offer a competitive, people-first benefits package designed to support every aspect of your life:

Core Benefits: Discretionary bonus, competitive pension, health insurance, life insurance and critical illness cover.

Mental Health: Easy access to CareFirst, Unmind, Aviva consultations, and in-house first aiders.

Family-Friendly: Maternity, adoption, shared parental leave, plus paid leave for sickness, pregnancy loss, fertility treatment, menopause, and bereavement.

Family Care: 8 complimentary backup care sessions for emergency childcare or elder care.

Holiday Flexibility: 5 weeks of annual leave with the option to buy or sell holiday days based on your needs.

Continuous Learning: Minimum 40 Hours of Training Annually: Take your pick—workshops, certifications, e-learning—your growth, your way. Also, Business Coach assigned from Day One: Get one-on-one guidance to fast-track your goals and accelerate your development.

Extra Perks: Gympass (Wellhub), travel insurance, Tastecard, season ticket loans, Cycle to Work, and dental insurance.

Inclusion at Capco
We’re committed to a barrier-free, inclusive recruitment process. If you need any adjustments at any stage, just let us know – we’ll be happy to help. We welcome applicants from all backgrounds. At Capco, we value the difference you make, and the differences that make you. Our #BeYourselfAtWork culture champions diversity, equity and inclusivity, and we bring a collaborative mindset to our partnerships with clients and colleagues. #BeYourselfAtWork is the cornerstone of our success and a value that our employees live and breathe every day.

Apply for this job

*

indicates a required field

First Name *

Last Name *

Email *

Phone

Country

Phone

Resume/CV

Enter manually

Accepted file types: pdf, doc, docx, txt, rtf

LinkedIn Profile

Website

Are you authorized to work in the country in which you’re applying? * Select...

Do you require Right to Work sponsorship now, or at any point in the future? * Select...

Do you know anyone or are you related to anyone who works at Capco? *

Were you referred to this role by a current Capco Employee? If yes, please confirm the employee’s Capco email address. Select...

If comfortable, please disclose if you need any reasonable adjustments during the recruitment process. Select...

If you answered yes on the previous question, please provide details below.

How did you hear about this role? * Select...

Capco Job Candidate Privacy Notice Acknowledgement * Select...

Capco Job Candidate Privacy Notice Acknowledgement

Capco does not and shall notdiscriminateon the basis of race, color, religion (creed), gender, gender expression, age, national origin (ancestry), disability, marital status, sexual orientation, or military status, in any of its activities or operations. In order to track the effectiveness of our recruiting efforts, please consider participating in the optional questionnaire.

Select...

I identify my ethnicity group as * Select...

I identify my ethnicity sub group as * Select...

By checking this box, I consent to Capco collecting, storing, and processing my responses to the demographic data surveys above. *