Senior ML QA Engineer – AI Platform & Governance

LSEG; Greater London; On-site; GBP 75,000 - 120,000; Full time

Job summary

London Stock Exchange Group (LSEG) is seeking a Senior Associate for the Corporate Engineering AI (CE AI) Team in London. The role focuses on evaluating MCP tools and Skills, building automated test pipelines, and mitigating agentic risk across a regulated enterprise.

You will partner with ML engineers to embed test hooks and contribute to a federated governance model for AI tools and platforms within LSEG.

Qualifications

• Strong Python experience for test harnesses and automation.
• Experience with LLM and RAG evaluation frameworks or custom evaluation pipelines.
• Test automation expertise covering unit, integration, and regression testing.
• Understanding of agentic system risks and failure modes.
• Ability to assess solutions against governance, security, and audit expectations.
• Experience working in regulated or highly governed engineering environments.

Responsibilities

• Define and implement evaluation frameworks for MCP tools and Skills covering correctness, safety, and regression impact.
• Build and maintain automated test pipelines for agentic behaviours, including tool invocation and multi‑step workflows.
• Evaluate and mitigate agentic failure modes such as hallucination, tool misuse, invalid inputs, and latency amplification.
• Produce testing evidence required for Permit to Build (PTB) and Permit to Operate (PTO).
• Partner with ML Engineers to embed testability and evaluation hooks into MCP servers and Skills.
• Help define the long‑term quality and governance model for federated MCP contributions across LSEG.

Skills

Python

LLM evaluation frameworks

Test automation

Agentic system risks

Governance, security, audit

Regulated engineering environments

Job description

London Stock Exchange Group (LSEG) is seeking a Senior Associate for the Corporate Engineering AI (CE AI) Team in London. The role focuses on evaluating MCP tools and Skills, building automated test pipelines, and mitigating agentic risk across a regulated enterprise.

You will partner with ML engineers to embed test hooks and contribute to a federated governance model for AI tools and platforms within LSEG.