Senior Data Engineer - AWS

Capco; London; Hybrid; GBP 70,000 - 90,000; Full time

Job summary

A financial services consulting firm in London is seeking a Senior Data Engineer with expertise in AWS to design and implement innovative cloud-based data pipelines. The ideal candidate will have strong experience in developing data architectures and mentoring junior engineers. Core benefits include competitive pay, a discretionary bonus, and a flexible holiday policy.

Benefits

Discretionary bonus

Health insurance

Flexible holiday policy

Access to continuous learning

Family-friendly leave options

Qualifications

• Strong hands-on experience in AWS-native tools.
• Proficient in Python, Scala or Java with strong Big Data experience.
• Practical knowledge of building real-time event streaming pipelines.

Responsibilities

• Design and build end-to-end data pipelines leveraging AWS tools.
• Collaborate with clients to define solutions.
• Lead the development of robust data engineering solutions.

Skills

AWS Glue

Python

Big Data technologies

Spark

Real-time event streaming

Data governance

Tools

AWS Lambda

AWS Redshift

Kafka

Job description

Senior Data Engineer - AWS
Location: London (Hybrid) | Practice Area: Technology & Engineering | Type: Permanent

Engineer future-ready data platforms that power financial transformation.

The Role
We're looking for a Senior Data Engineer with AWS to join our growing team of engineering experts driving next-gen transformation for Tier 1 financial services clients. You'll play a pivotal role in designing, building, and deploying cloud-based data pipelines. Working across greenfield projects and enterprise-scale platforms, your work will directly impact the way data is ingested, transformed, and served at scale across the financial services industry.

What You'll Do

• Design and build end-to-end data pipelines leveraging AWS-native tools and modern data architectures.
• Collaborate with clients to gather requirements, define solutions, and deliver production-grade systems.
• Apply AWS Well-Architected Principles to ensure scalability, security, and resilience.
• Lead in the development of robust, tested, and fault-tolerant data engineering solutions.
• Support and mentor junior engineers, contributing to knowledge sharing across the team.

What We're Looking For

• Strong hands-on experience across AWS Glue, Lambda, Step Functions, RDS, Redshift, and Boto3.
• Proficient in one of Python, Scala or Java, with strong experience in Big Data technologies such as: Spark, Hadoop etc.
• Practical knowledge of building real-time event streaming pipelines (e.g., Kafka, Spark Streaming, Kinesis).
• Proven experience developing modern data architectures including Data Lakehouse and Data Warehousing.
• A solid understanding of CI/CD practices, DevOps tooling, and data governance including GDPR.

Bonus Points For

• Expertise in Data Modelling, schema design, and handling both structured and semi-structured data.
• Familiarity with distributed systems such as Hadoop, Spark, HDFS, Hive, Databricks.
• Exposure to AWS Lake Formation and automation of ingestion and transformation layers.
• Background in delivering solutions for highly regulated industries.
• Passion for mentoring and enabling data engineering best practices across teams.

Why Join Capco

• Deliver high-impact technology solutions for Tier 1 financial institutions
• Work in a collaborative, flat, and entrepreneurial consulting culture
• Access continuous learning, training, and industry certifications
• Be part of a team shaping the future of digital financial services
• Help shape the future of digital transformation across FS & Energy

We offer a competitive, people-first benefits package designed to support every aspect of your life:

• Core Benefits: Discretionary bonus, competitive pension, health insurance, life insurance and critical illness cover.
• Mental Health: Easy access to CareFirst, Unmind, Aviva consultations, and in-house first aiders.
• Family-Friendly: Maternity, adoption, shared parental leave, plus paid leave for sickness, pregnancy loss, fertility treatment, menopause, and bereavement.
• Family Care: 8 complimentary backup care sessions for emergency childcare or elder care.
• Holiday Flexibility: 5 weeks of annual leave with the option to buy or sell holiday days based on your needs.
• Continuous Learning: Minimum 40 Hours of Training Annually: Take your pick-workshops, certifications, e-learning-your growth, your way. Also, Business Coach assigned from Day One: Get one-on-one guidance to fast-track your goals and accelerate your development.
• Healthcare Access: Convenient online GP services.
• Extra Perks: Gympass (Wellhub), travel insurance, Tastecard, season ticket loans, Cycle to Work, and dental insurance.

Inclusion at Capco
We're committed to a barrier-free, inclusive recruitment process. If you need any adjustments at any stage, just let us know - we'll be happy to help. We welcome applicants from all backgrounds. At Capco, we value the difference you make, and the differences that make you. Our #BeYourselfAtWork culture champions diversity, equity and inclusivity, and we bring a collaborative mindset to our partnerships with clients and colleagues. #BeYourselfAtWork is the cornerstone of our success and a value that our employees live and breathe every day.