Senior Data Engineer – Spark, AWS & Lakehouse (Hybrid)

Korn Ferry; West Midlands; Hybrid; GBP 90,000 - 120,000; Full time

Job summary

Korn Ferry is seeking an experienced Senior Data Engineer to join a major enterprise technology programme in the financial services sector. The role focuses on designing, building and optimising large-scale data pipelines in an AWS environment, with support for AI/ML initiatives and generative AI data platforms.

The candidate will design and implement ETL/ELT workflows, work on data lakehouse architectures, and ensure data quality, governance, security, and monitoring across production systems.

Qualifications

• 5+ years of commercial Data Engineering experience.
• Strong programming experience with Java and/or Scala.
• Strong AWS experience, ideally including technologies such as S3, EMR, Glue and IAM.
• Advanced SQL development skills.
• Experience designing and developing ETL/ELT pipelines.
• Experience with large-scale distributed data-processing environments.
• Databricks and/or Snowflake.

Responsibilities

• Design, build and maintain high-throughput data pipelines using Apache Spark and cloud-native technologies.
• Develop scalable ETL/ELT workflows for structured and unstructured datasets.
• Build and optimise data-processing solutions within AWS environments.
• Develop performant solutions using Java or Scala alongside advanced SQL.
• Support modern data lake and lakehouse architectures.
• Work alongside AI/ML teams to provide data platforms supporting Generative AI, machine learning and advanced analytics use cases.
• Implement appropriate data quality, governance, security and monitoring standards.
• Troubleshoot complex data-processing and distributed-system issues within production environments.

Skills

Java/Scala programming

SQL development

Data pipelines design

Distributed data processing

Tools

Apache Spark

AWS (S3, EMR, Glue, IAM)

Databricks

Snowflake

Job description

Korn Ferry is seeking an experienced Senior Data Engineer to join a major enterprise technology programme in the financial services sector. The role focuses on designing, building and optimising large-scale data pipelines in an AWS environment, with support for AI/ML initiatives and generative AI data platforms.

The candidate will design and implement ETL/ELT workflows, work on data lakehouse architectures, and ensure data quality, governance, security, and monitoring across production systems.