On Agentic AI Platform Engineer

On; Greater London; Hybrid; GBP 90,000 - 150,000; Full time

Job summary

On is building a dedicated AI & ML Platform team to deliver scalable, observable, and governance-focused agentic AI infrastructure. We seek engineers who can scale pipelines, ship reliable services, and collaborate across product and business teams to embed AI at scale.

You will work on production-grade systems, including evaluation frameworks, routing gateways, and LLM orchestration, while aligning with security and reliability standards across a global brand.

Qualifications

• Strong background in backend, platform, or data engineering with ML/AI platform exposure.
• 3+ years for mid-level, 5+ years for senior, with production-grade agentic AI experience.

Responsibilities

• Architect, scale, and maintain agentic infrastructure and core platform components.
• Partner with business and product teams to accelerate adoption of agentic workflows.
• Contribute to cross-functional strategy for a unified AI/ML ecosystem and ensure secure, observable production systems.
• Establish engineering best practices and evaluate tooling to support safe, scalable AI at scale.

Skills

Backend Engineering

ML Platform experience

AgentOps

Cloud (GCP)

Observability

Communication

Tools

LangSmith

LangFuse

LLM Gateways

Job description

We are looking for an AI Platform Engineer to join the newly established AI and ML Platform team at On. As one of the fastest-growing global sports brands, investing in autonomous intelligence is critical to On’s strategy and our company goals for 2026 and beyond. While our existing squad has built a strong MLOps foundation, we need to inject additional deep, production-grade agentic expertise in the team. In this role, you will partner with your peers to mature the scalability, observability, and governance of our AI platform-ultimately shaping the blueprint for how a global brand leverages AI at scale.

Your Mission

As an AI Platform Engineer, you will play a key role in shaping the technical direction, delivery standards, and architectural quality for agentic solutions within the AI & ML platform space. Your core goals include:

• Build & Operate Agentic Infrastructure: Architect, scale, and maintain highly reliable, secure, and observable core platform components (e.g., evaluation frameworks, routing, gateways) for both internal and customer-facing autonomous use cases.
• Empower Applied Solutions: Act as a trusted partner to business and product teams, providing the tooling and architectural guidance they need to accelerate their adoption of high-impact agentic workflows.
• Contribute to AI & ML Convergence: Bring a deep curiosity for how LLMOps and traditional MLOps intersect, collaborating with peers to explore and test the strategy for a unified, hybrid AI/ML ecosystem.
• Navigate Ambiguity & Champion Standards: Thrive in a fast-paced environment to turn ambiguous requirements into scalable features. Establish engineering best practices, evaluate cutting-edge tooling, and foster technical consensus across the org.

Your Story

You are an expert engineer who pairs deep infrastructure experience with a proven track record in the emerging AgentOps space. You know what "good" looks like in traditional platform engineering, and you have successfully translated that rigor into scaling Agentic AI safely.

• Core Engineering & Production AI Experience: You have a strong background in backend, platform, or data engineering, with a strong preference for candidates who bring prior experience in MLOps or ML Platform engineering.
• For a Mid-Level role: You have 3+ years of overall software engineering experience, with at least 1 year of demonstrable experience building and maintaining production-grade components for Agentic AI / LLM systems.
• For a Senior-Level role: You have 5+ years of overall software engineering experience, with a proven track record of architecting, building, and leading major components of a production agentic infrastructure, far beyond the prototype phase.
• Deep Agentic & Cloud Stack Expertise: You are fluent in modern agentic frameworks, cognitive architectures, and cloud ecosystems (GCP preferred). You know how to architect and interface with core platform components (vector/graph databases, semantic caches, and LLM orchestration gateways) and integrate external systems and tools via modern standards like the Model Context Protocol (MCP).
• Observability & Evaluations: You have experience implementing robust evaluation and observability frameworks (such as LangSmith, LangFuse, etc.) to monitor agent performance, quality, and cost.
• Governance & Velocity: You have a mature, critical perspective on balancing delivery speed with safety, ensuring reliable and secure agent behavior in production without stifling innovation.
• Collaborative Mindset: You thrive on ambiguous, zero-to-one infrastructure challenges. You are an exceptional, low-ego communicator (both written and verbal) who excels at building consensus, establishing deep partnerships, and earning trust with both technical peers and non-technical stakeholders.

Meet The Team

The AI & ML Platform team is a newly established pillar within our Data and AI Org, tasked with driving the scale, efficiency, and global velocity of both traditional Machine Learning and next-generation Agentic AI across On. We focus on architecting and operating production-grade infrastructure—from robust LLM gateways and evaluation frameworks to scalable ML pipelines. Beyond building the core engine, we act as trusted partners to teams looking to adopt Agentic AI solutions, providing the guidance, tooling, and best practices they need to implement their use cases successfully. Our mission is to empower product teams and define a unified AI/ML ecosystem that scales with On’s global momentum.

What We Offer

On is a place that is centered around growth and progress. We offer an environment designed to give people the tools to develop holistically— to stay active, to learn, explore and innovate. Our distinctive approach combines a supportive, team-oriented atmosphere, with access to personal self-care for both physical and mental well-being, so each person is led by purpose.

On is an Equal Opportunity Employer. We are committed to creating a work environment that is fair and inclusive, where all decisions related to recruitment, advancement, and retention are free of discrimination.