Senior Data Platform Engineer - Lead for AI & Cloud

StepStone Group; United Kingdom; Hybrid; GBP 100,000 - 150,000; Full time

Benefits offered by this job

29 days holiday

Private medical

Dental healthcare

Pension 10%

EAP 24/7

Life insurance

Cycle to work

Hybrid working

Volunteer days

Dog-friendly office

Job summary

The Stepstone Group is seeking a Senior Staff Engineer to lead the Data Platform architecture across data, platform and infrastructure domains. You will shape technical direction, drive governance and collaborate with Engineering Managers, Product Managers and Enterprise Architects.

In this role you will build scalable data capabilities for analytics and AI, mentor engineers, improve code quality and observability, and help deliver critical data solutions for the business.

Qualifications

• Proven experience as Staff Engineer or Principal Engineer or equivalent senior IC leadership role.
• Strong background in data platforms, distributed systems and cloud-native architectures.
• Solid expertise in AWS, Terraform, Kafka/MSK, Airflow, Glue or Spark for building scalable data solutions.
• Experience with modern data ecosystems including data lakes/lakehouse architectures and batch/streaming processing.
• Knowledge of data quality, governance, cataloguing and observability tools (e.g. Datadog), with DBT or AI-assisted engineering practices a plus.

Responsibilities

• Define and evolve the technical vision, roadmap and architecture of the Data Platform, driving decisions across data, platform and infrastructure domains.
• Establish engineering standards, best practices and reusable patterns while partnering with Enterprise Architecture and influencing technical direction.
• Drive engineering excellence by improving code quality, testing, observability, reliability and operational practices.
• Support end-to-end delivery by guiding teams through complex technical challenges, improving decision-making, and contributing to planning and risk management.
• Mentor engineers, grow senior technical capabilities and champion AI-assisted development and engineering automation.

Skills

Staff/Principal Engineer

Distributed systems

Cloud-native architectures

AWS

Tools

AWS

Terraform

Kafka/MSK

Airflow

Glue/Spark

Job description

The Stepstone Group is seeking a Senior Staff Engineer to lead the Data Platform architecture across data, platform and infrastructure domains. You will shape technical direction, drive governance and collaborate with Engineering Managers, Product Managers and Enterprise Architects.

In this role you will build scalable data capabilities for analytics and AI, mentor engineers, improve code quality and observability, and help deliver critical data solutions for the business.