Manager, AI Operations

Xsolis; United States; On-site; USD 150,000 - 230,000; Full time

Benefits offered by this job

Medical/Dental/Vision insurance

401K company match

Flexible Paid Time Off

Paid parental leave

HSA/FSA options

Educational reimbursement program

EAP & Mental Health services

Job summary

Xsolis, headquartered in Franklin, TN, is seeking an experienced AI Operations leader to own the reliability, performance, and observability of our AI portfolio in production—spanning traditional ML, GenAI, and agentic AI systems. This role focuses on uptime, drift management, and secure, scalable production systems.

You will lead a small, high-leverage production support and observability team, set priorities across monitoring workstreams, and mentor staff to build a strong on-call culture

Qualifications

• 7+ years of experience in AI/ML operations, MLOps or production data science, including 2+ years of people or team leadership.
• Hands-on experience operating traditional ML and GenAI systems in production (deployment, monitoring, incident response).
• Strong understanding of observability practices — drift detection, model performance monitoring, logging, alerting — at scale.
• Experience partnering with Security and Infrastructure teams on production risk and access controls.
• Excellent communication skills, with the ability to translate operational risk into terms both technical and business stakeholders understand.

Responsibilities

• Own deployment support, monitoring, and day-to-day reliability of AI systems in production across traditional ML, GenAI, and agentic AI.
• Lead incident response and root-cause troubleshooting for AI/ML services, including agentic systems with autonomous or tool-using behavior.
• Partner with MLOps, Cloud Engineering, and Infrastructure teams to build and maintain robust deployment pipelines.

Skills

AI/ML operations

MLOps

Observability

Security collaboration

Leadership

Communication

Tools

Datadog

AWS CloudWatch

LangFuse

AWS

Job description

Redefining Healthcare with AI

Xsolis is an AI-driven technology company reducing administrative waste in healthcare by enabling smarter collaboration between providers and payers. Since 2013, our vision has been to create a frictionless healthcare system.

Xsolis is an AI-driven technology company reducing administrative waste in healthcare by enabling smarter collaboration between providers and payers. Since 2013, our vision has been to create a frictionless healthcare system.

We are proudly headquartered in Franklin, TN - one of the nation's fastest-growing hubs for healthcare innovation - we are at the heart of a thriving ecosystem of health systems, payers, and technology leaders.

Our flagship product, Dragonfly®, is the first and only AI-driven platform to continuously assign real-time predictive scores for medical necessity. Dragonfly has delivered proven results across 600+ hospital, health system, and health plan clients and earned repeated industry recognition. With recognition on the Inc. 5000 and Deloitte Technology Fast 500 lists, Xsolis is also one of the fastest-growing privately-held companies in the country and across North America, and we're looking for talented people to grow with us.

Position Summary Details

We are seeking an experienced AI Operations leader to own the reliability, performance, and observability of our AI portfolio in production — spanning traditional machine learning, Generative AI, and Agentic AI systems. This role is ideal for a technically strong manager who thinks in terms of uptime, drift, and risk, and who can translate models and agents built by our data science teams into scalable, monitored, and secure production systems.

You will lead a team responsible for AI production support, observability, and the operational connective tissue between our AI build organization, security, and infrastructure functions to lead tactical and strategic roadmap for us to become a leader in “Ethical AI”. This role does not own model development or AI governance policy — it owns making sure everything we ship runs well, is visible, and is safe to operate at scale.

Essential Duties & Responsibilities

The essential functions include, but are not limited to the following:

• AI Production Operations
  • Own deployment support, monitoring, and day-to-day reliability of AI systems in production across traditional ML, GenAI, and agentic AI.
  • Lead incident response and root-cause troubleshooting for AI/ML services, including agentic systems with autonomous or tool-using behavior.
  • Partner with MLOps, Cloud Engineering, and Infrastructure teams to build and maintain robust deployment pipelines.
• Observability & Model Performance Monitoring
  • Build and maintain observability practices (drift detection, latency, uptime, accuracy decay, agent action-level tracing) across all AI system types.
  • Define and track production health metrics; flag performance degradation and route it to the appropriate build team for remediation.
  • Establish dashboards and alerting that give the organization real-time visibility into AI system health.
• Security & Cross-Functional Liaison
  • Serve as the primary connection point between AI systems and enterprise Security, Infrastructure, and IT teams — ensuring production AI meets security and access-control standards.
  • Support the AI Governance function by instrumenting and operating the fairness, safety, and bias-monitoring metrics it defines (governance sets the requirement; this team builds and runs the instrumentation).
  • Coordinate handoffs from the AI Build team into production, including a defined production-readiness review before launch.
• Team Leadership
  • Lead and grow a small, high-leverage production support and observability team.
  • Set clear priorities across production support and monitoring workstreams and manage team capacity as the AI portfolio scales.
  • Mentor team members and build a strong operational and on-call culture.
• Establish Xsolis as “Ethical AI Leader” in our space
  • Lead cross functional team to assess what is required in design, dev and run-time across our entire AI stack to establish “Ethical AI” best practices and SOPs for Xsolis
  • Ensure the Cost of AI Dev and Run-time is clear and targeted for specific annual reduction YoY
  • Work with Governance and Compliance team to set standards that are measurable, monitored and auditable through the observability platform across Traditional, Generative and Agentic AI.

Experience

Minimum Qualifications (Knowledge, Skills, and Abilities)

• Required:
  • 7+ years of experience in AI/ML operations, MLOps or production data science, including 2+ years of people or team leadership.
  • Hands-on experience operating traditional ML and GenAI systems in production (deployment, monitoring, incident response).
  • Strong understanding of observability practices — drift detection, model performance monitoring, logging, alerting — at scale.
  • Experience partnering with Security and Infrastructure teams on production risk and access controls.
  • Excellent communication skills, with the ability to translate operational risk into terms both technical and business stakeholders understand.

Preferred

• Prior experience in healthcare, health tech, payer, or provider organizations.
• Experience operating agentic AI systems specifically (tool-use monitoring, guardrails, action-level tracing).
• Familiarity with MLOps/observability tooling (Datadog, AWS Cloud Watch, LangFuse) and native AWS cloud platform capabilities.
• Experience working alongside a dedicated AI Governance function, with clear boundaries between operational monitoring and governance policy.

Working Environment And Travel Requirements

• Work is typically in a normal office administrative environment involving minimal exposure to physical risks.
• Position requires little to moderate physical activity. Mostly sedentary work exerting up to 10 pounds of force occasionally or a negligible amount of force to lift, carry, push, pull, or otherwise move objects. Work involves sitting most of the time, but may involve walking or standing for brief periods of time. No significant stooping is usually required.
• This role requires travel to our home offices in TN for training.

Physical Demands & Work Environment

The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this position.

Reasonable accommodations may be made to enable individuals with disabilities to perform the functions.

In any role at Xsolis, it's a chance to make a complex healthcare system a little more efficient alongside a team that's passionate, fast-moving, and genuinely invested in your success. Your contributions will shape both our product and our culture.

Full-time Employees' Total Rewards Package Include

• Medical/Dental/Vision insurance
• 401K company match
• Flexible Paid Time Off
• Paid parental leave
• HSA/FSA options
• Educational reimbursement program
• Employer-paid EAP & Mental Health services

Xsolis is proud to be an equal opportunity employer. We celebrate diversity and are committed to building an inclusive environment for all. We encourage candidates of every background to apply.

All candidates must successfully pass a background check and fall under the same security role, which includes access to sensitive information, including proprietary data and PHI.

Work Authorization Notice: Please note that we do not provide visa sponsorship or immigration support for this position. Applicants must already be authorized to work in the United States on a full-time, permanent basis without the need for current or future sponsorship.

All official communications from our recruitment team will only come from @xsolis.com. Verify open roles at https://www.xsolis.com/about/careers. For information regarding how we collect, use, and protect applicant personal information, please review our CCPA Privacy Notice for Job Applicants.