Principal Data Engineer (AWS) — Data Platform Lead

korecv; Greater London; Ibrido; GBP 120.000 - 180.000; Tempo pieno

Vantaggi offerti da questo lavoro

Discretionary bonus

Competitive pension

Health insurance

Life insurance

Critical illness cover

Mental health support

Five weeks holiday

Training & certifications

GP services

Cycle to Work

Descrizione del lavoro

Capco in London is seeking a Principal Data Engineer with AWS to design, build and operate scalable data platforms for Tier 1 financial services clients.

You will lead end-to-end data pipelines on AWS, mentor engineers, and apply Well-Architected principles, data governance and responsible AI practices to deliver high-quality data solutions while collaborating with cross-functional teams.

Competenze

• Strong proficiency in Python, Scala, or Java with hands-on experience in Spark/Hadoop or similar frameworks.
• Experience building real-time streaming using Kafka, Spark Streaming or Kinesis in AWS.
• Designing modern data architectures (Data Lakehouse/Data Warehousing) with CI/CD and governance including GDPR.
• Collaborative mindset with ability to deliver scalable cloud solutions and apply AI-enabled tools responsibly.

Mansioni

• Design and build end-to-end data pipelines using AWS-native services and modern cloud data architectures.
• Partner with clients and cross-functional teams to translate requirements into production-grade data platforms.
• Apply AWS Well-Architected Principles, CI/CD, and AI-enabled development practices to improve quality and efficiency.
• Lead development of robust, fault-tolerant data solutions while promoting governance and responsible engineering practices.
• Mentor engineers and promote responsible use of approved AI tools to enhance delivery.

Conoscenze

Python/Scala/Java

Spark

Hadoop

Kafka

Kinesis

Data Lakehouse

Data Warehousing

CI/CD

DevOps

GDPR

AI tools

Descrizione del lavoro

Capco in London is seeking a Principal Data Engineer with AWS to design, build and operate scalable data platforms for Tier 1 financial services clients.

You will lead end-to-end data pipelines on AWS, mentor engineers, and apply Well-Architected principles, data governance and responsible AI practices to deliver high-quality data solutions while collaborating with cross-functional teams.