Senior AI Engineer for Healthcare LLM Apps (Remote)

Roger Healthcare; San Francisco (CA); Hybrid; USD 200,000 - 250,000; Full time

Benefits offered by this job

Health insurance

Unlimited PTO

401(k) plan

Job summary

Roger Healthcare is hiring a Senior Applied AI Engineer to craft the intelligence layer for in-home clinician workflows. You will train and fine-tune models, design evaluation metrics, and build robust inference systems used by frontline clinicians.

You will work with open-source models, establish observability, and ship production-grade AI capabilities that improve patient outcomes while maintaining cost efficiency, reliability, and security.

Qualifications

• 7+ years of professional software engineering experience with meaningful depth in AI/ML.
• Experience training, fine-tuning, or evaluating LLMs and open source models, with real opinions about what works and what does not.
• Shipped real AI software to real users; be able to describe a project, what went wrong, and how you fixed it.
• Strong instincts for evals, observability, and feedback loops that turn user feedback into measurable improvement.
• Experience building agentic systems: tool use, generator and critic loops, planners and executors, orchestration where one agent’s output drives another’s work.
• Comfort building infrastructure that is fast, reliable, and cost-efficient at scale.
• Startup experience shipping real features in high-growth environments.
• A product mindset, comfort across the stack, and the ability to operate in ambiguity without a clean spec.
• High standards for reliability and accuracy when real clinicians and patients depend on your work.

Responsibilities

• Train and fine-tune open source models, leveraging our proprietary data for higher accuracy.
• Build eval datasets and pipelines to measure model accuracy rigorously and improve it.
• Design metrics, harnesses, and feedback loops to translate clinical outcomes into measurable improvements.
• Build scalable, cost-efficient inference infrastructure with strong monitoring.
• Develop agentic infrastructure and interfaces that translate model capability into a good clinician experience.
• Stay at the frontier of research and open source frameworks and bring the best into production.
• Prototype quickly and harden into scalable, secure production systems.

Skills

AI/ML engineering

LLM fine-tuning

Model evaluation

Observability

Distributed systems

Tools

PyTorch

TensorFlow

Langchain/LLM tooling

Job description

Roger Healthcare is hiring a Senior Applied AI Engineer to craft the intelligence layer for in-home clinician workflows. You will train and fine-tune models, design evaluation metrics, and build robust inference systems used by frontline clinicians.

You will work with open-source models, establish observability, and ship production-grade AI capabilities that improve patient outcomes while maintaining cost efficiency, reliability, and security.