Senior ML Engineer: Production AI for Healthcare

Apply; San Francisco, Northern (CA, KY); Hybrid; USD 225,000 - 300,000; Full time

Benefits offered by this job

Medical, Dental, Vision

401(k) with company match

Remote-friendly culture

Equipment provisioning

Parental leave

Annual off-sites

Flexible time off

Job summary

Ambience Healthcare is seeking a Senior Machine Learning Engineer to build and improve AI systems powering clinical products. You will own projects end-to-end, diagnose production failures, and translate cutting-edge research into reliable, production-grade AI solutions.

This hybrid role requires onsite work at our San Francisco office three days per week, collaborating with clinicians, product managers, and engineers to deliver high-impact healthcare AI.

Qualifications

• 5+ years in production ML, research engineering, or applied AI.
• Strong understanding of modern LLMs, transformers, and production AI systems.
• Experience designing evaluations for LLMs, agents, or other complex AI systems.
• Production-grade software engineering with Python and ML frameworks; deployment and observability.
• Experience building production systems involving multiple models, tools, retrieval, and orchestration.

Responsibilities

• Design and own evaluation pipelines for LLM and agentic systems.
• Diagnose failure modes and improve model behavior across prompts, retrieval, context, or data.
• Develop production AI systems involving tool use, context management, routing, and orchestration.
• Turn production failures and feedback into better datasets and evaluations.
• Stay at the cutting edge by translating research into practical experiments.
• Own AI systems end-to-end across models, data, and serving in production.

Skills

Production AI

Evaluation design

Agentic systems

Python

PyTorch

CI/CD

Observability

Cross-functional collaboration

LLMs/Transformers

Containerization

Tools

PyTorch

Docker

Job description

Ambience Healthcare is seeking a Senior Machine Learning Engineer to build and improve AI systems powering clinical products. You will own projects end-to-end, diagnose production failures, and translate cutting-edge research into reliable, production-grade AI solutions.

This hybrid role requires onsite work at our San Francisco office three days per week, collaborating with clinicians, product managers, and engineers to deliver high-impact healthcare AI.