Lead Data Engineer - Multi Strat Hedge Fund

Selby Jennings; City Of London; On-site; GBP 90,000 - 140,000; Full time

Job summary

Selby Jennings is working with a fast-growing hedge fund in London to hire a Lead Data Engineer. You will lead the design and delivery of scalable data pipelines and cloud-native data platforms, partnering with Quant Researchers, PMs, and analysts to enable research and investment decisions.

You will mentor engineers, shape engineering standards, and drive the evolution of a next-generation data platform in a collaborative, fast-paced environment.

Qualifications

• Strong Python and SQL development experience in large-scale production environments.
• Experience building modern data platforms using Snowflake or similar cloud data warehouse technologies.
• Hands-on AWS and cloud-native data architecture knowledge; exposure to data observability is a plus.

Responsibilities

• Design and deliver scalable data pipelines and platform services.
• Architect cloud-native solutions for diverse data types (market, structured, unstructured).
• Improve data quality, observability, monitoring, and resilience across the platform.
• Collaborate with researchers, portfolio managers, and analysts to deliver data products.
• Mentor engineers and influence architectural direction.

Skills

Python

SQL

Snowflake

AWS

Airflow

Data pipelines

Leadership

Tools

Snowflake

Airflow

AWS

Job description

Our client, a fast-growing multi-strategy hedge fund, is looking for a Lead Data Engineer in London to help build and scale the data platforms that underpin research, analytics, applications, and investment decision-making across the firm. Working within a highly collaborative data engineering team, you'll partner directly with Quant Researchers, Portfolio Managers, Analysts, and technology teams to deliver cloud-first data solutions, shape technical standards, and play a key role in the evolution of a next-generation data platform. This is a hands-on leadership position offering significant influence over architecture, engineering direction, mentoring, and future team growth.

Responsibilities

• Lead the design and delivery of scalable data pipelines, platform services, and analytics-ready datasets
• Architect cloud-native solutions supporting market, alternative, structured, and unstructured data
• Drive improvements across data quality, observability, monitoring, and operational resilience
• Partner with investment and research teams to deliver high-impact data products
• Mentor engineers and influence engineering standards, best practices, and technical direction

Requirements

• Strong commercial experience with Python and SQL in large-scale production environments
• Expertise building modern data platforms using Snowflake or similar cloud data warehouse technologies
• Hands-on experience with AWS and cloud-native data architecture
• Experience with workflow orchestration tools such as Airflow
• Proven track record leading complex technical projects and influencing architecture decisions

Why Apply?

This is an opportunity to join one of the most ambitious investment platforms in the market, working on business-critical data infrastructure that directly impacts investment outcomes. You'll have significant ownership, exposure to senior stakeholders, and the chance to help shape the future of a rapidly expanding data engineering function.