Remote AI Performance & Operations Lead

Devoted Health, Inc.; United States; On-site; USD 110,000 - 172,000; Full time

Benefits offered by this job

Employer sponsored health, dental and vision plan

Generous paid time off

$100 monthly mobile or internet stipend

Stock options for all employees

Bonus eligibility

Parental leave program

401K program

Job summary

TVET College is looking for a Senior Manager, AI Performance & Operations to oversee the performance and improvement of core AI workflows. This role includes responsibility for assessing workflow health, leading incident responses, and ensuring effective communication of technical changes.

The ideal candidate will possess strong applied AI expertise, excellent strategic communication, and a commitment to accountable outcomes. The position offers a salary ranging from $110,000 to $172,000 annually, along with a comprehensive benefits package.

Qualifications

• Strong production experience with LLMs, RAG, voice AI.
• Experience designing or operating rubrics and scoring frameworks.
• Ability to distinguish failure modes and conduct post-mortems.
• Comfort with active experimentation for model migrations.
• Excellent judgment and communication in high-accountability environments.
• Deep personal accountability with a drive to own results.

Responsibilities

• Own the health of major AI workflows ensuring operational outcomes.
• Maintain a current view of all major workflows and their states.
• Monitor weekly indicators and oversee production dashboards.
• Lead response for AI regressions and drive post-mortems.
• Run structured hypothesis testing for mini-launches.
• Guide new workflows to ensure proper launch safety models.

Skills

Applied AI Expertise

Evaluation Systems

Diagnostic Acumen

Optimization Mindset

Strategic Communication

Outcome Ownership

Job description

TVET College is looking for a Senior Manager, AI Performance & Operations to oversee the performance and improvement of core AI workflows. This role includes responsibility for assessing workflow health, leading incident responses, and ensuring effective communication of technical changes.

The ideal candidate will possess strong applied AI expertise, excellent strategic communication, and a commitment to accountable outcomes. The position offers a salary ranging from $110,000 to $172,000 annually, along with a comprehensive benefits package.