Senior Agentic AI Operations & Reliability Engineer

MultiPlan; McLean (VA); In loco; USD 165.000 - 185.000; Tempo pieno

Vantaggi offerti da questo lavoro

Health insurance

401k

Bonus opportunity

Descrizione del lavoro

Claritev is seeking a Principal Agentic AI Operations Engineer to lead the operationalization, evaluation, and reliable production performance of advanced agentic AI systems for healthcare products.

You will define what good looks like for agent behavior in high-stakes workflows, build evaluation harnesses, benchmarks, and tooling to prove reliability and safety at scale in production environments.

Competenze

• 10+ years of hands-on experience in software engineering, ML engineering, platform/SRE engineering, or a related technical discipline.

Mansioni

• Own the end-to-end operational lifecycle of production agentic AI systems: deployment, versioning, rollout strategies, monitoring, incident response, rollback, and continuous improvement.

Conoscenze

Python proficiency

Distributed systems design

MLOps/LLMOps concepts

Cloud computing

Communication

Problem solving

Formazione

Bachelor's degree in Computer Science, Engineering, Data Science, a quantitative discipline, or a related field

Master's degree or PhD preferred

Strumenti

Terraform

Kubernetes

LangSmith

Langfuse

Arize Phoenix

Ragas

DeepEval

promptfoo

OpenAI Evals

Descrizione del lavoro

Claritev is seeking a Principal Agentic AI Operations Engineer to lead the operationalization, evaluation, and reliable production performance of advanced agentic AI systems for healthcare products.

You will define what good looks like for agent behavior in high-stakes workflows, build evaluation harnesses, benchmarks, and tooling to prove reliability and safety at scale in production environments.