Principal Data Engineer

Capco; London; Hybrid; GBP 90,000 - 120,000; Full time

Job summary

A financial services consultancy in London seeks a Principal Data Engineer to lead the design and delivery of secure, scalable data solutions for Tier 1 financial institutions. This role involves collaborating with cross-functional teams to define data strategies and ensuring best practices in data engineering. Applicants should have expertise in real-time data streaming, cloud platforms, and programming in SQL, Python, Java, and Scala.

Benefits

Discretionary bonus

Health insurance

Pension

Training and development

Gympass(Wellhub)

Qualifications

• Expertise in real-time data streaming platforms.
• Proven track record in data architecture and schema design.
• Deep experience with cloud platforms and migration projects.

Responsibilities

• Architect scalable and fault-tolerant data pipelines.
• Lead data engineering best practices including security and automation.
• Mentor engineers and foster a high-performing engineering culture.

Skills

Real-time data streaming platforms (Kafka, Spark Streaming, Flink)

Data architecture and schema design

Cloud platforms (especially GCP)

SQL

Python

Java

Scala

Tools

IAC tools (Terraform)

CI/CD pipelines (Jenkins, CircleCI)

Observability tools (Prometheus, Grafana, Elastic, Splunk)

RDBMS and NoSQL databases

Cloud-native warehouses (BigQuery, Snowflake)

Job description

Principal Data Engineer

Location: London (Hybrid) | Practice Area: Technology & Engineering | Type: Permanent

Shape the future of data at the heart of financial services

The Role

As a Principal Data Engineer at Capco, you'll lead the design and delivery of robust, scalable, and secure data engineering solutions for Tier 1 financial institutions. You will work across cloud and on-premise environments, leveraging cutting-edge technologies to architect data solutions that underpin digital transformation. You'll collaborate closely with cross-functional teams to drive strategic data initiatives, ensuring best practices and a high standard of delivery.

What You'll Do

• Architect scalable and fault-tolerant data pipelines using streaming and batch technologies
• Lead data engineering best practices including security, testing, and automation
• Guide teams in tooling decisions, ensuring alignment with business and technical strategies
• Collaborate with clients to define data strategies and ensure optimal solutions are implemented
• Mentor engineers and lead by example, fostering a high-performing engineering culture

What We're Looking For

• Expertise in real-time data streaming platforms (Kafka, Spark Streaming, Flink)
• Proven track record in data architecture and schema design for structured and semi-structured data
• Deep experience with cloud platforms (especially GCP) and migration projects
• Strong proficiency in SQL, Python, Java, and Scala
• Demonstrable leadership in engineering strategy, security, and quality assurance

Bonus Points For

• Experience with IAC tools like Terraform and CI/CD pipelines using Jenkins or CircleCI
• Familiarity with observability tools (Prometheus, Grafana, Elastic, Splunk)
• Exposure to both RDBMS and NoSQL databases, and cloud-native warehouses like BigQuery or Snowflake
• Knowledge of DataOps or DevOps practices in production-scale environments
• Passion for experimentation and staying ahead with data and cloud innovations

Why Join Capco

• Deliver high-impact technology solutions for Tier 1 financial institutions
• Work in a collaborative, flat, and entrepreneurial consulting culture
• Access continuous learning, training, and industry certifications
• Be part of a team shaping the future of digital financial services
• Help shape the future of digital transformation across FS & Energy.

Benefits

We offer a competitive, people-first benefits package designed to support every aspect of your life:

• Core Benefits: Discretionary bonus, competitive pension, health insurance, life insurance and critical illness cover.

• Mental Health: Easy access to CareFirst, Unmind, Aviva consultations, and in-house first aiders.

• Family-Friendly: Maternity, adoption, shared parental leave, plus paid leave for sickness, pregnancy loss, fertility treatment, menopause, and bereavement.

• Family Care: 8 complimentary backup care sessions for emergency childcare or elder care.

• Holiday Flexibility: 5 weeks of annual leave with the option to buy or sell holiday days based on your needs.

• Continuous Learning: Your growth, your way - minimum 40 hours of training annually. Take your pick; workshops, certifications, e-learning. Also, Business Coach assigned from Day One: Get one-on-one guidance to fast-track your goals and accelerate your development.

• Healthcare Access: Convenient online GP services.

• Extra Perks: Gympass(Wellhub), travel insurance, Tastecard, season ticket loans, Cycle to Work, and dental insurance.

Inclusion at Capco

We're committed to making our recruitment process accessible and straightforward for everyone. If you need any adjustments at any stage, just let us know - we'll be happy to help. We value each person's unique perspective and contribution. At Capco, we believe that being yourself is your greatest strength. Our #BeYourselfAtWork culture encourages individuality and collaboration - a mindset that shapes how we work with clients and each other every day.