Senior Big Data Engineer – Spark and Risk Data Lead

Capgemini; Greater London; Hybrid; GBP 80,000 - 100,000; Full time

Benefits offered by this job

Wellbeing support

Training and development opportunities

Flexible working conditions

Job summary

A global technology consulting firm is seeking a Senior Big Data Engineer to build scalable data platforms. Candidates should have 16+ years of engineering experience with deep expertise in Spark, Scala, and Python. The role involves designing data pipelines, optimizing workloads, and collaborating with multiple teams. This position emphasizes employee wellbeing, diversity, and offers extensive training opportunities to foster innovation and personal growth.

Qualifications

• 16+ years of data/software engineering experience with expertise in Spark, Scala, Python.
• Strong background in designing large-scale ETL/ELT workflows.
• Solid understanding of trade data and counterparty risk.

Responsibilities

• Design and build distributed data pipelines using Spark in Scala and Python.
• Architect scalable ingestion and transformation frameworks.
• Optimize Spark workloads, ensure production reliability.

Skills

Spark

Scala

Python

Data Engineering

ETL/ELT Workflows

Data Governance

Trade Data

Market Risk Processes

Job description

A global technology consulting firm is seeking a Senior Big Data Engineer to build scalable data platforms. Candidates should have 16+ years of engineering experience with deep expertise in Spark, Scala, and Python. The role involves designing data pipelines, optimizing workloads, and collaborating with multiple teams. This position emphasizes employee wellbeing, diversity, and offers extensive training opportunities to foster innovation and personal growth.