Senior ML Quality Engineer for AI Platform & Governance

London Stock Exchange Group; Greater London; On-site; GBP 70,000 - 110,000; Full time

Job summary

London Stock Exchange Group in London is seeking a Senior Associate Machine Learning Quality Engineer to join the Corporate Engineering AI team. You will help define evaluation frameworks and build automated test pipelines for MCP tools and Skills.

You will collaborate with ML engineers to integrate evaluation hooks, address agentic risks, and provide testing evidence for PTB and PTO, ensuring governance, security, and audit readiness across the enterprise AI platform.

Qualifications

• Strong Python experience for test harnesses and automation.
• Experience with LLM and RAG evaluation frameworks or custom evaluation pipelines.
• Test automation expertise covering unit, integration, and regression testing.
• Understanding of agentic system risks and failure modes.
• Ability to assess solutions against governance, security, and audit expectations.

Responsibilities

• Define and implement evaluation frameworks for MCP tools and Skills covering correctness, safety, and regression impact.
• Build and maintain automated test pipelines for agentic behaviours, including tool invocation and multi-step workflows.
• Evaluate and mitigate agentic failure modes such as hallucination, tool misuse, invalid inputs, and latency amplification.
• Produce testing evidence required for Permit to Build (PTB) and Permit to Operate (PTO).
• Partner with ML Engineers to embed testability and evaluation hooks into MCP servers and Skills.
• Help define the long-term quality and governance model for federated MCP contributions across LSEG.

Skills

Python

LLM evaluation

RAG evaluation

Test automation

Governance & security

Agentic systems risks

Job description

London Stock Exchange Group in London is seeking a Senior Associate Machine Learning Quality Engineer to join the Corporate Engineering AI team. You will help define evaluation frameworks and build automated test pipelines for MCP tools and Skills.

You will collaborate with ML engineers to integrate evaluation hooks, address agentic risks, and provide testing evidence for PTB and PTO, ensuring governance, security, and audit readiness across the enterprise AI platform.