Lead Software Engineer

Ellipse; Greater London; Hybrid; GBP 90,000 - 120,000; Full time

Benefits offered by this job

Flexible working times

Employee Assistance Programme

Company pension scheme

Life insurance

Training and development opportunities

Job summary

Ellipse is seeking a senior data platform engineer to lead the design, development and operation of data engineering platforms and AWS infrastructure for hybrid work in Kennington, London. You will collaborate with Product, Engineering and Data Science to translate business needs into scalable data solutions and secure pipelines.

You will drive ingestion, processing and delivery of data from multiple sources, build reliable CI/CD and platform automation, and ensure high availability and disaster

Qualifications

• 5+ years building scalable data pipelines and cloud-native solutions on AWS.
• Experience with ETL/ELT, data ingestion, large-scale processing, and data modelling.
• Strong knowledge of distributed data systems, security, and performance optimisation.
• Hands-on AWS: EC2, S3, RDS, Lambda, VPC, IAM, CloudWatch and related services.
• Infrastructure as Code: Terraform or CloudFormation; familiarity with EKS.

Responsibilities

• Lead design, development, and operation of data engineering platforms and AWS infrastructure.
• Translate business requirements into scalable data, cloud, and infrastructure solutions.
• Develop ingestion, processing, storage, and delivery of data from multiple sources securely and efficiently.
• Collaborate with Engineering, Data Science, UX and DevOps to manage pipelines, CI/CD, and reliability.
• Drive delivery, coordination and resilience, ensuring high availability and disaster recovery readiness.
• Contribute to ideation and delivery of new platform capabilities with focus on automation and data quality.
• Lead operational activities during critical Horse Racing events for BAU continuity.

Skills

Python

SQL

AWS

ETL/ELT

Data modelling

CI/CD

Kubernetes

Docker

Monitoring

Security

Tools

Terraform

CloudFormation

Cursor

Gemini

Job description

About

Ellipse is an industry leader in the collection, analysis and dissemination of live sports performance data. Our goal is to engage our diverse audience with new stories about sports. We create products and services across cricket, football, horse racing, rugby and tennis that enrich the experience of fans, athletes, and teams worldwide. Our data is a central component of media coverage, betting operations, athlete feedback and coach decision‑making in some of the biggest competitions.

Location

Kennington, London (Hybrid - 3 days a week)

Responsibilities

• Lead and oversee the design, development, and operation of our data engineering platforms, AWS infrastructure, and cloud-based product offerings.
• Work closely with Product teams, understand business requirements and translate them into scalable data, cloud, and infrastructure solutions.
• Develop and implement strategies for ingesting, processing, storing, and delivering data from multiple sources in a secure, reliable, and efficient manner.
• Lead and collaborate with Engineering, Data Science, UX and DevOps teams to manage cloud infrastructure, design analysis, deployment pipelines, CI/CD processes, platform reliability, and release management frameworks.
• Drive technical delivery, team coordination, and business continuity initiatives, ensuring high availability, disaster recovery readiness, operational resilience, and platform stability.
• Be a key contributor to the ideation, planning, execution, and validation of existing and new platform capabilities, with a focus on improving engineering processes, infrastructure automation, data quality, and operational excellence.
• Ability to lead and support key operational activities during critical Horse Racing events, ensuring system availability, performance, incident response, and business-as-usual (BAU) continuity under high‑demand conditions.

Requirements

Data Engineering and Platform Developement

• At least 5 years of commercial experience building scalable data pipelines, data platforms, and cloud-native solutions using Python. SQL & AWS Services.
• Experience designing and developing ETL/ELT processes, data ingestion frameworks, and large-scale data processing solutions.
• Strong understanding of distributed data systems, data modelling, data quality, and performance optimisation.
• Strong hands‑on experience with AWS services including EC2, S3, RDS, Lambda, VPC, IAM, CloudWatch, and related cloud services.
• Experience designing, deploying, and managing secure, scalable, and highly available cloud infrastructure.
• Knowledge of infrastructure automation and Infrastructure as Code using EKS (Terraform), CloudFormation, or similar tools.
• Strong understanding of networking, security, monitoring, backup, and disaster recovery practices.

Databases&Data Management

• Solid experience with relational databases, cloud data platforms, and data workflows involving database design, optimisation, performance tuning, and management using RDS/RDBMS and related technologies.
• Understanding of metrics generation, data integrity, data migrations, and lifecycle management.
• Experience managing large datasets and supporting analytical & operational workloads.

Devops & Platform Operations

• Experience in containerisation using Docker, Orchestration and scaling with Kubernetes.
• Experience building and maintaining automated deployment pipelines and CI/CD workflows.
• Experience implementing monitoring, alerting, logging, and operational support processes.
• Strong focus on platform reliability, business continuity, support and operational resilience.

Leadership and Engineering Practices

• Experience leading engineering teams, mentoring engineers, conducting code and design reviews, and driving technical best practices.
• Experience designing scalable, maintainable, secure, and production-ready platforms.
• Familiarity with best practices around reliability, observability, security, and performance optimisation.
• Knowledge of Horse Racing as a Sport, Rules, major Events & its Data would be highly advantageous in the selection process.
• Understanding of UI tech stack like React and related technologies.
• Exposure to NoSQL, graph databases, and vector databases.
• Understanding of AI native engineering processes and usage of AI tools like Cursor or Gemini to develop workflows.

Equality & diversity:

Ellipse is committed to building an open and inclusive culture that supports personal development and learning. Ellipse believes in the principle of equal opportunity in employment and its employment policies for recruitment, training, development and promotion despite any differences based on individual grounds of race, colour, nationality, religion or belief, sex, sexual orientation, marital status, age, ethnic and national origin, disability or gender reassignment.

• Flexible working times
• Employee Assistance Programme
• Company pension scheme
• Life insurance
• Training and development opportunities

About Ellipse

Ellipse is a leading sports data and analytics company comprising CricViz, FootballViz, Horse Racing, RugbyViz (Oval and Stuart Farmer Media Services), and TennisViz. Working with the world’s biggest broadcasters, professional teams, and rights holders, we simplify complex data to engage a broad and diverse audience and tell better stories about the sports we love.