Lead Software Engineer - ML Platform Quality Engineering

ZipRecruiter; City Of London; On-site; GBP 100,000 - 125,000; Full time

Job summary

A global financial services firm is seeking a Lead Software Engineer to develop robust validation frameworks for an enterprise-grade AI/ML Data Platform. This hands-on role involves designing tools, enhancing CI/CD pipelines, and collaborating with various engineering teams to ensure quality across platform components. Ideal candidates will have significant experience in backend systems, expertise in Python, and familiarity with CI/CD practices and AWS services. A Bachelor's or Master's degree in a relevant field is required.

Qualifications

• Extensive years of software development experience in backend systems or platform engineering.
• Hands-on experience with CI/CD systems.
• Deep understanding of software engineering best practices.

Responsibilities

• Design and build high-performance tools to validate ML data pipelines.
• Develop platform-level test automation frameworks.
• Collaborate with engineering teams to embed quality in platform components.

Skills

Python

CI/CD systems

OOP

Infrastructure-as-Code

AWS services

Education

Bachelor's or Master's degree in Computer Science, Engineering, or related technical discipline

Tools

Terraform

GitHub Actions

Jenkins

Job description

Overview

Lead Software Engineer - AI/ML Data Platform (Test Engineering)
Location: London
Employment Type: 6 months to 1 year contract

A global financial services firm is seeking a Lead Software Engineer to join a cutting-edge initiative focused on building an enterprise-grade AI/ML Data Platform. This role is at the forefront of Test Engineering, with a mission to develop robust, intelligent validation frameworks and infrastructure that ensure the quality and reliability of machine learning and data products across the firm.

This is a hands-on software engineering role embedded in platform quality and reliability initiatives. You will architect and build tools, services, and automation to elevate assurance across large-scale distributed systems. If you are passionate about CI/CD excellence, infrastructure-as-code, and platform validation, this is a unique opportunity to have meaningful impact.

Key Responsibilities

• Design and build high-performance tools and services to validate ML data pipelines and AI infrastructure.
• Develop platform-level test automation frameworks using Python, Terraform, and cloud- practices.
• Enhance CI/CD pipelines with integrated automated testing, resilience checks, and observability mechanisms.
• Lead initiatives promoting platform testability, resilience, and validation-as-code principles.
• Collaborate with MLOps, infrastructure, and software engineering teams to embed quality deeply into platform components.
• Build reusable components that support scalability, modularity, and self-service quality tooling.
• Mentor junior engineers and help set engineering standards across the Test Engineering program.

Required Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or related technical discipline.
• Extensive years of software development experience in backend systems or platform engineering.
• Expertise in Python, with solid understanding of OOP, testing frameworks, and automation tooling.
• Hands-on experience with CI/CD systems such as GitHub Actions or Jenkins.
• Strong familiarity with AWS services including Lambda, S3, ECS/EKS, Step Functions, and CloudWatch.
• Proficient in Infrastructure-as-Code using Terraform.
• Deep understanding of software engineering best practices: code quality, reliability, performance tuning, and observability.

Qualifications

• Exposure to machine learning workflows or data engineering platforms.
• Experience with distributed systems, event-driven architectures (e.g., Kafka), and big data frameworks (e.g., Spark, Databricks).
• Understanding of financial services, data governance, or compliance-driven development.
• Knowledge of platform security, monitoring, and resilient design patterns.

________________________________________

This is a high-impact opportunity to work with modern technologies at enterprise scale and help shape the future of AI/ML platforms in a highly regulated industry. If you\'re ready to bring engineering rigor to validation and platform quality, we\'d love to hear from you.

We are committed to creating an inclusive recruitment experience. If you have a long-term health condition and require adjustments to the recruitment process, our Adjustment Concierge Service is here to support you. Please reach out to us at [e-mail] to discuss further.

This position is being recruited on behalf of our client through our Outsourcing service line. Resource Solutions Limited, trading as Robert Walters, acts as an employment business and agency, partnering with top organizations to help them find the best talent. We welcome applications from all candidates and are committed to providing equal opportunities.