Applied AI Engineer: Healthcare AI at Scale

R1 RCM Holdco Inc.; United States; On-site; USD 140,000 - 350,000; Full time

Benefits offered by this job

Top-of-market compensation

Flexible PTO

Comprehensive health benefits

401(k) matching

Competitive benefits package

Job summary

R1 RCM Inc. is hiring an Applied AI Scientist to transform complex healthcare workflows into reliable production AI systems.

You will design and optimize AI agents for healthcare use cases, evaluate model performance, and collaborate with clinical, product, and engineering teams to translate real-world challenges into scalable AI solutions. You will build end-to-end AI capabilities, including agent training, tool use, memory, and verification, while prototyping new capabilities and ensuring

Qualifications

• 4+ years of experience in software engineering, machine learning engineering, applied AI, research engineering, or a related field.
• Strong proficiency in Python and experience building production applications using APIs, structured data, testing, logging, and observability tools.
• Experience with LLM applications, AI agents, RAG (Retrieval-Augmented Generation), prompt engineering, tool calling, structured outputs, or machine learning systems.
• Experience designing evaluation frameworks, benchmarks, experimentation workflows, and performance monitoring for AI systems.
• Ability to work in ambiguous, high-impact environments and translate complex real-world problems into scalable AI solutions.

Responsibilities

• Design, build, and iterate on agentic AI systems for complex healthcare workflows, including documentation, coding, denial management, appeals, and revenue cycle automation.
• Develop long-horizon agent behavior across context construction, retrieval, tool use, memory, routing, verification, escalation, and human-in-the-loop review.
• Define what “good” looks like for clinical agents end-to-end, translating expert workflows into specifications, rubrics, gold standards, test cases, and clinically meaningful success criteria.
• Build rigorous evaluation and feedback loops using expert review, production logs, model outputs, and benchmarks to measure performance, regressions, edge cases, safety, reliability, provenance quality, and business impact.
• Prototype new AI capabilities from 0 to 1, then harden them into reliable, explainable, auditable production systems with clear contracts, monitoring, evidence, rationale, and performance gates.
• Partner with research and ML engineering teams on model selection, fine‑tuning, reward modeling, distillation, synthetic data, post‑training, and internal AI infrastructure, including instrumentation, experiment tracking, benchmarking, prompt/version management, and reproducible evaluation.

Skills

Python

API development

Structured data

Testing

Logging

Observability

LLM applications

AI agents

RAG

Prompt engineering

Tool calling

Structured outputs

ML systems

Evaluation frameworks

Benchmarks

Experimentation

Performance monitoring

Problem solving

Job description

R1 RCM Inc. is hiring an Applied AI Scientist to transform complex healthcare workflows into reliable production AI systems.

You will design and optimize AI agents for healthcare use cases, evaluate model performance, and collaborate with clinical, product, and engineering teams to translate real-world challenges into scalable AI solutions. You will build end-to-end AI capabilities, including agent training, tool use, memory, and verification, while prototyping new capabilities and ensuring