Remote UK LLMOps Engineer: Production AI Reliability

Better Placed

United Kingdom

Remoto

GBP 70.000 - 110.000

Tempo integral

Há 4 dias
Seja uma das primeiras pessoas a se candidatar

Receba uma resposta desta empresa empregadora

Seu currículo e carta de apresentação personalizados exatamente para o que estão contratando.

Passe pelos filtros ATS

Resumo da vaga

Better Placed is seeking a hands-on LLMOps Engineer to own monitoring, evaluation and reliability for live AI systems in a fully remote UK role. You will build and run production pipelines for LLM outputs, manage tool calls, observability and regression checks, and collaborate with AI engineers to improve performance and quality.

Ideal candidates have real commercial experience operating AI systems in production, strong Python skills, AWS familiarity and a track record of delivering reliable,

Qualificações

  • Hands-on experience building production LLM evaluation and monitoring pipelines.
  • Experience beyond prototype work; production systems required.
  • Strong Python development and debugging skills.
  • Experience with AWS and observability, logging, tracing, alerting.

Responsabilidades

  • Build and maintain monitoring, observability and evaluation pipelines for production AI and LLM applications.
  • Develop automated evaluation frameworks to measure response accuracy, retrieval quality, hallucinations, consistency and performance.
  • Monitor and troubleshoot agentic AI workflows, including tool calls, orchestration failures, context handling and multi-step execution.
  • Identify and investigate changes in model behaviour, output quality and performance over time.
  • Build dashboards, alerts and quality metrics to help the team understand AI performance.
  • Support model upgrades, prompt changes, version management and provider transitions.
  • Investigate production incidents across AI applications, data pipelines, APIs and supporting infrastructure.
  • Work closely with AI Engineers to improve reliability and operational processes.

Conhecimentos

Production AI monitoring
Python development
Observability & debugging
AWS experience
CI/CD & automated testing
Problem-solving
Production monitoring

Ferramentas

Kubernetes
Docker
Terraform
LangChain
Langfuse
LangSmith

Descrição da vaga

Better Placed is seeking a hands-on LLMOps Engineer to own monitoring, evaluation and reliability for live AI systems in a fully remote UK role. You will build and run production pipelines for LLM outputs, manage tool calls, observability and regression checks, and collaborate with AI engineers to improve performance and quality.

Ideal candidates have real commercial experience operating AI systems in production, strong Python skills, AWS familiarity and a track record of delivering reliable,

Obtenha sua revisão de currículo grátis e confidencial.

ou arraste e solte seu arquivo aqui.

Similar jobs

Vagas similares que valem a pena comparar

Platform Engineer (AI / LLM Operations)
Platform Engineer (AI / LLM Operations)

Better Placed • Grã-Bretanha

Remoto
GBP 70.000 - 110.000
Senior AI Engineer: Production ML & MLOps
Senior AI Engineer: Production ML & MLOps

Netcompany • Leeds

Híbrido
GBP 90.000 - 120.000
Hybrid working model
25 days’ holiday
Private Medical Health care via Vitaly
+5
MLOps Engineer
MLOps Engineer

Harnham • Greater London

Híbrido
GBP 75.000 - 95.000
Senior MLOps Engineer: AI Production & Edge Deployments
Senior MLOps Engineer: AI Production & Edge Deployments

MFK Recruitment • Brentford

Híbrido
GBP 70.000 - 100.000
Remote AI Platform Engineer — Production-Grade LLM Systems
Remote AI Platform Engineer — Production-Grade LLM Systems

Harnham • Greater London

Remoto
GBP 95.000 - 130.000
Senior MLOps Engineer - Python, AWS & LLMs (Remote)
Senior MLOps Engineer - Python, AWS & LLMs (Remote)

Client Server Limited • Greater London

Híbrido
GBP 90.000 - 110.000
Salary up to £100k
WFH budget
Mostly remote with London meetups
Senior ML Engineer - Production AI & MLOps (London Hybrid)
Senior ML Engineer - Production AI & MLOps (London Hybrid)

Data Idols • City Of London

Híbrido
GBP 80.000 - 110.000
Production ML Engineer: GenAI, AWS & MLOps
Production ML Engineer: GenAI, AWS & MLOps

Understanding Recruitment Ltd • England

Híbrido
GBP 70.000 - 110.000
MLOps Engineer
MLOps Engineer

Harnham - Data & Analytics Recruitment • City Of London

Híbrido
GBP 75.000 - 95.000
Bonus
Benefits
MLOps Engineer: Scale ML Deployments & Pipelines (Remote)
MLOps Engineer: Scale ML Deployments & Pipelines (Remote)

Harnham - Data & Analytics Recruitment • Greater London

Híbrido
GBP 96.000 - 126.000