Staff AI Engineer

R1; United States; Hybrid; USD 244,000 - 470,000; Full time

Benefits offered by this job

Hybrid work (NYC)

Job summary

R1 in New York City is seeking an Applied AI Engineer/Scientist to build, evaluate, and continuously improve clinical AI agents and supervised ML models. You will work at the intersection of software engineering, LLM systems, evaluation, model improvement, and deep healthcare workflow understanding.

Your job is to turn frontier model capability into reliable production behavior: agents that read medical records, use clinical context, call the right tools, produce auditable outputs, and improve

Qualifications

• 12+ years of software/ML engineering or applied AI experience.
• Experience turning messy real-world workflows into structured AI problems.
• Comfortable building production systems with APIs and observability.

Responsibilities

• Design, build, and iterate on agentic AI systems for healthcare workflows.
• Develop long-horizon agent behavior across context, retrieval, tool use, and memory.
• Define success criteria and evaluation rubrics for clinical agents.
• Build evaluation loops using production logs, model outputs, and benchmarks.
• Harden prototypes into auditable, production-grade systems with monitoring.

Skills

Python

Production systems

LLM

Agent design

Evaluation

Tools

APIs

Testing

Observability

Experiment tracking

Job description

About R1

At R1, we’re transforming how healthcare works by combining nearly two decades of revenue cycle expertise with advanced technology, including analytics, AI, intelligent automation and workflow orchestration. We pair that technology with the irreplaceable expertise of our people to help hospitals, health systems and medical groups improve financial performance, simplify administrative complexity and create better experiences for patients and providers. All Together Better defines our culture and the way we work. We’re a diverse, global team united by a shared mission to make healthcare work better for all. Across technology, operations and support functions, our people bring deep expertise, empathy and ingenuity to the work we do. Here, collaboration fuels progress, adaptability sparks innovation and every voice can help shape what’s next for R1 and the future of healthcare.

About R37

R37 R37 is R1’s AI innovation lab, building technology to transform healthcare. Our flagship platform, Phare OS, uses AI and automation to improve critical pre-bill workflows, including authorization, utilization management, documentation and coding. By identifying and resolving issues before claims are submitted, Phare OS helps prevent denials, improve reimbursement and move revenue cycle work upstream. What makes R37 different is the opportunity to build advanced AI at real-world scale. R1 works across 95 of the top 100 U.S. health systems, giving R37 access to the data, workflows and reach needed to make an immediate impact: 180M+ claims 550M+ patient encounters 1.2B+ workflow actions and outcomes annually This is startup-level ownership with enterprise-level impact. You’ll build technology that moves from idea to real healthcare environments, solving complex problems at scale and changing how healthcare works.

The Role

We are looking for an Applied AI Engineer/Scientist to build, evaluate, and continuously improve clinical AI agents and supervised ML Models. You will work at the intersection of software engineering, LLM systems, evaluation, model improvement, and deep healthcare workflow understanding.

Your job is to turn frontier model capability into reliable production behavior: agents that read complex medical records, use the right clinical and coding context, call the right tools, produce auditable outputs, and improve from real-world failures. You will be embedded in hard healthcare problems — clinical documentation integrity, medical coding, denial prevention, appeals, revenue cycle workflows, and payer logic — and will own the loop from problem framing to agent design, evaluation, deployment, trace analysis, and ongoing improvement. The ideal candidate is a strong engineer who thinks like an applied scientist: rigorous about measurement, comfortable with ambiguity, excited by messy real-world data, and motivated by closing the gap between impressive demos and dependable production systems.

We prefer this role to be Hybrid (3 days onsite) at our SOHO Office Hub in New York City.

What You’ll Do

• Design, build, and iterate on agentic AI systems for complex healthcare workflows, including documentation, coding, denial management, appeals, and revenue cycle automation.
• Develop long-horizon agent behavior across context construction, retrieval, tool use, memory, routing, verification, escalation, and human-in-the-loop review.
• Define what “good” looks like for clinical agents end-to-end, translating expert workflows into specifications, rubrics, gold standards, test cases, and clinically meaningful success criteria.
• Build rigorous evaluation and feedback loops using expert review, production logs, model outputs, and benchmarks to measure performance, regressions, edge cases, safety, reliability, provenance quality, and business impact.
• Prototype new AI capabilities from 0 → 1, then harden them into reliable, explainable, auditable production systems with clear contracts, monitoring, evidence, rationale, and performance gates.
• Partner with research and ML engineering teams on model selection, fine-tuning, reward modeling, distillation, synthetic data, post-training, and internal AI infrastructure, including instrumentation, experiment tracking, benchmarking, prompt/version management, and reproducible evaluation.

What Makes This Role Different

Most AI roles are either too research-heavy or too product-light. This role sits in the middle. You will not only write prompts or run experiments. You will own whether an agent actually works in production.

That means understanding the workflow, designing the system, building the evals, inspecting failures, improving the agent, and proving that the improvement matters.

The right person will be excited by questions like: What context does this agent need to make the right decision? How do we know the output is clinically and operationally correct? Which failures are prompt problems, retrieval problems, model problems, tool problems, or product-spec problems? How do we turn expert feedback into a better benchmark or training set? When should we use prompting, RAG, rules, fine-tuning, reward modeling, or a different architecture? How do we make agent outputs auditable enough for clinical and operational review? How do we build a data flywheel that improves the system every week?

You May Be a Good Fit If You Bring

• 12+ years of software engineering, ML engineering, research engineering, or applied AI experience.
• Have had impact at the organizational level; Have led multiple teams or multiple broad initiatives simultaneously, ensuring that high-level technical goals are met across the entire organization.
• Are highly proficient in Python and comfortable building production systems with APIs, structured data, async workflows, testing, logging, and observability.
• Have experience turning messy real-world workflows into structured AI problems, including classification, ranking, extraction, decisioning, LLM applications, agents, RAG, tool calling, structured outputs, prompting, or evaluation.
• Have built or operated evaluation systems, benchmarks, annotation workflows, experiment tracking, or regression tests for AI systems.
• Thrive in ambiguous, high-stakes domains: working with experts, debugging real-world failures, and turning model potential into reliable, correct, safe systems that work for users.

Compensation

For this US-based position, the base pay range is $243,915.00 - $470,408.00 per year . Individual pay is determined by role, level, location, job-related skills, experience, and relevant education or training.

This job is eligible to participate in our annual bonus plan at a target of 25.00%.

Benefits

We go beyond expectations in everything we do. Not only does that drive customer success and improve patient care, but that same enthusiasm is applied to giving back to the community and taking care of our team — including offering a competitive benefits package.

Equal Opportunity

R1 RCM Inc. (“the Company”) is dedicated to the fundamentals of equal employment opportunity. The Company’s employment practices , including those regarding recruitment, hiring, assignment, promotion, compensation, benefits, training, discipline, and termination shall not be based on any person’s age, color, national origin, citizenship status, physical or mental disability, medical condition, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status or any other characteristic protected by federal, state or local law. Furthermore, the Company is dedicated to providing a workplace free from harassment based on any of the foregoing protected categories.

If you have a disability and require a reasonable accommodation to complete any part of the job application process, please contact us at 312-496-7709 for assistance.

Contact Information

CA PRIVACY NOTICE: California resident job applicants can learn more about their privacy rights California Consent To learn more, visit: R1RCM.com

Visit us on Facebook R1 is the leader in healthcare revenue management, helping providers achieve new levels of performance through smart orchestration. A pioneer in the industry, R1 created the first Healthcare Revenue Operating System: a modular, intelligent platform that integrates automation, AI, and human expertise to strengthen the entire revenue cycle. With more than 20 years of experience, R1 partners with 1,000 providers, including 95 of the top 100 U.S. health systems, and handles over 270 million payer transactions annually. This scale provides unmatched operational insight to help healthcare organizations unlock greater long-term value. To learn more, visit: https://www.r1rcm.com.