Senior ML Quality Engineer — AI Platform Governance

London Stock Exchange Group; Greater London; On-site; GBP 70,000 - 100,000; Full time

Benefits offered by this job

Healthcare

Retirement planning

Paid volunteering days

Wellbeing initiatives

Job summary

The London Stock Exchange Group is seeking a Senior Quality Engineer to join the Corporate Engineering AI team. You will design, implement, and maintain evaluation frameworks for MCP tools and Skills, and collaborate with ML engineers to ensure testability across MCP servers.

The role focuses on safety, governance, and reliable agentic performance in a regulated engineering environment. You will build automated test pipelines for agentic behaviours, monitor for hallucinations and tool misuse,

Qualifications

• Strong Python experience for test harnesses and automation.
• Experience with LLM and RAG evaluation frameworks or custom evaluation pipelines.
• Test automation expertise covering unit, integration, and regression testing.
• Understanding of agentic system risks and failure modes.
• Ability to assess solutions against governance, security, and audit expectations.

Responsibilities

• Define and implement evaluation frameworks for MCP tools and Skills covering correctness, safety, and regression impact.
• Build and maintain automated test pipelines for agentic behaviours, including tool invocation and multi-step workflows.
• Evaluate and mitigate agentic failure modes such as hallucination, tool misuse, invalid inputs, and latency amplification.
• Produce testing evidence required for Permit to Build (PTB) and Permit to Operate (PTO).
• Partner with ML Engineers to embed testability and evaluation hooks into MCP servers and Skills.
• Help define the long-term quality and governance model for federated MCP contributions across LSEG.

Skills

Python

Evaluation frameworks

Test automation

Agentic system risk

Governance & security

Regulated environment

Job description

The London Stock Exchange Group is seeking a Senior Quality Engineer to join the Corporate Engineering AI team. You will design, implement, and maintain evaluation frameworks for MCP tools and Skills, and collaborate with ML engineers to ensure testability across MCP servers.

The role focuses on safety, governance, and reliable agentic performance in a regulated engineering environment. You will build automated test pipelines for agentic behaviours, monitor for hallucinations and tool misuse,