Principal Agentic AI Operations Engineer

Claritev; United States; On-site; USD 150,000 - 190,000; Full time

Job summary

Claritev is seeking a Principal Agentic AI Operations Engineer to lead the operationalization, evaluation, and reliable production performance of advanced agentic AI systems powering Claritev's healthcare products.

The role emphasizes building evaluation harnesses, benchmarks, and tooling to ensure trustworthy, secure, and cost-efficient AI operations at scale, collaborating with product, engineering, AI science, security, and business leadership.

Responsibilities

• Own the end-to-end operational lifecycle of production agentic AI systems: deployment, versioning, rollout strategies, monitoring, incident response, rollback, and continuous improvement.

Job description

Job Description

We are seeking a Principal Agentic AI Operations Engineer to provide hands-on technical leadership for the operationalization, evaluation, and reliable production performance of the advanced agentic AI systems powering Claritev's next generation of healthcare products.

Job Description

We are seeking a Principal Agentic AI Operations Engineer to provide hands-on technical leadership for the operationalization, evaluation, and reliable production performance of the advanced agentic AI systems powering Claritev's next generation of healthcare products.

This role is for an experienced engineer who excels at making agentic AI systems trustworthy at scale — measurable, observable, benchmarked, secure, and cost-efficient in production. Where AI engineering teams build agents, you will own how those agents are evaluated, deployed, monitored, governed, and continuously improved. You will define what “good” looks like for agent behavior in high-stakes healthcare workflows and build the evaluation harnesses, benchmarks, and operational tooling that prove it.

You will partner closely with Product, Engineering, AI Science, Security, and business leaders to establish the operational backbone of Claritev's agentic AI platform, set engineering and evaluation standards, make key architectural decisions, and mentor engineers and scientists across the organization.

Job Roles And Responsibilities

• Own the end-to-end operational lifecycle of production agentic AI systems: deployment, versioning, rollout strategies, monitoring, incident response, rollback, and continuous improvement.