Senior Data Platform Engineer - Financial Indices AWS/Python

London Stock Exchange; Greater London; On-site; GBP 110,000 - 170,000; Full time

Job summary

London Stock Exchange is building the next-generation index data platform. You will design, write, and ship production software, primarily in Python, setting standards for engineering through your code.

You’ll own technical direction for a defined area, mentor engineers, and drive quality across the team. The role involves building data-intensive systems on AWS, with services like Lambda, containers, Glue, and Iceberg, while emphasising observability, testing, and secure development practices.

Qualifications

• Hands-on Lead IC responsible for architecture and delivery in a defined area.
• Design data-intensive software across AWS services with attention to data modelling and performance.
• Experience in financial indices or data-intensive financial products is a plus.

Responsibilities

• Own technical direction and architecture for a defined area of the platform.
• Lead design of systems—services, APIs, libraries—with resilience, performance, and maintainability.
• Drive engineering quality through code reviews, tests, refactoring, automation, and secure practices.
• Mentor engineers through pairing, code reviews, and design guidance.
• Assess design trade-offs, risk, and production readiness; resolve blockers.
• Design data-intensive software across relational DBs (Aurora PostgreSQL/PostgreSQL), object storage, and AWS.
• Build data processing on AWS using Lambda, containers, Glue, EMR Serverless, and Iceberg formats.
• Embed observability and quality controls to identify issues before customers see them.
• Take ownership of production outcomes and ensure operable, reliable software.
• Collaborate across teams and translate complex ideas for technical and non-technical audiences.
• Develop deep knowledge of the financial indices domain to guide decisions.
• Maintain a hands-on approach, continuing coding and architecture work weekly.

Skills

Python

AWS

CI/CD

PostgreSQL

PySpark

Apache Iceberg

Terraform

AWS CDK

Docker

Kubernetes

Tools

GitLab CI

Jenkins

GitHub Actions

Databricks

Snowflake

Job description

London Stock Exchange is building the next-generation index data platform. You will design, write, and ship production software, primarily in Python, setting standards for engineering through your code.

You’ll own technical direction for a defined area, mentor engineers, and drive quality across the team. The role involves building data-intensive systems on AWS, with services like Lambda, containers, Glue, and Iceberg, while emphasising observability, testing, and secure development practices.