AI Platform Quality Engineer – MCP & Agentic Systems

LSEG; Hyderabad City Taluka; On-site; PKR 1,800,000 - 3,200,000; Full time

Job summary

London Stock Exchange Group (LSEG) is seeking a Senior Associate for the Corporate Engineering AI (CE AI) Team. You will help build and govern production‑grade agentic AI platforms that scale safely across the enterprise.

Responsibilities include defining evaluation frameworks, building automated test pipelines for MCP tools and Skills, and partnering with ML engineers to embed testing and governance. This is a dynamic, global role within a culture built on integrity, excellence and change,

Qualifications

• Strong Python experience for test harnesses and automation.
• Experience with LLM and RAG evaluation frameworks or custom evaluation pipelines.
• Test automation expertise covering unit, integration, and regression testing.
• Understanding of agentic system risks and failure modes.
• Ability to assess solutions against governance, security, and audit expectations.
• Experience working in regulated or highly governed engineering environments.

Responsibilities

• Define and implement evaluation frameworks for MCP tools and Skills covering correctness, safety, and regression impact.
• Build and maintain automated test pipelines for agentic behaviours, including tool invocation and multi‑step workflows.
• Evaluate and mitigate agentic failure modes such as hallucination, tool misuse, invalid inputs, and latency amplification.
• Produce testing evidence required for Permit to Build (PTB) and Permit to Operate (PTO).
• Partner with ML Engineers to embed testability and evaluation hooks into MCP servers and Skills.
• Help define the long‑term quality and governance model for federated MCP contributions across LSEG.

Skills

Python automation

LLM evaluation

Test automation

Governance requirements

Regulated environments

MCP tools

Job description

London Stock Exchange Group (LSEG) is seeking a Senior Associate for the Corporate Engineering AI (CE AI) Team. You will help build and govern production‑grade agentic AI platforms that scale safely across the enterprise.

Responsibilities include defining evaluation frameworks, building automated test pipelines for MCP tools and Skills, and partnering with ML engineers to embed testing and governance. This is a dynamic, global role within a culture built on integrity, excellence and change,