Obtenez une réponse de cet employeur
Votre CV et votre lettre de motivation, adaptés exactement à ce que l’employeur recherche.
Better Placed is seeking a hands-on LLMOps Engineer to own monitoring, evaluation and reliability for live AI systems in a fully remote UK role. You will build and run production pipelines for LLM outputs, manage tool calls, observability and regression checks, and collaborate with AI engineers to improve performance and quality.
Ideal candidates have real commercial experience operating AI systems in production, strong Python skills, AWS familiarity and a track record of delivering reliable,
Fully Remote (UK) Permanent
My client is a substantial, private equity-backed UK business investing heavily in AI and automation as part of a major technology transformation.
They're looking for a hands‑on LLMOps Engineer with proven experience building and operating monitoring and evaluation pipelines for LLM applications in live production environments.
This isn't a traditional Machine Learning Engineer, MLOps or AI application development position.
The focus is on ensuring production LLM and agentic AI systems deliver reliable, accurate and measurable results.
You’ll be working on automated LLM output evaluation, hallucination and groundedness checks, agent tracing, regression testing, observability and production reliability.
Essential: Recent, hands‑on experience personally building production LLM evaluation and monitoring pipelines. Experience limited to traditional ML model monitoring or building RAG applications without ongoing evaluation will not be sufficient.
Strong Python engineering skills are required, with AWS experience highly desirable.
You’ll take ownership of monitoring, troubleshooting and improving live AI systems, working across LLMs, agentic workflows, retrieval pipelines and cloud infrastructure.
A key focus will be ensuring AI applications don’t just remain available, but continue to produce accurate, consistent and useful results.
We're particularly interested in candidates who can demonstrate real commercial experience operating AI systems in production, rather than solely building prototypes or proofs of concept.
You don't need experience with every tool listed. We're more interested in what you've personally built, monitored and improved in production.
This is an opportunity to join a business making a significant investment in applied AI, with the chance to influence how its AI systems are monitored, evaluated and operated.
You’ll be working on real production applications, collaborating with an established engineering team and helping shape the standards for AI reliability and quality across the organisation.