Staff AI/ML Engineer - LLMs & Agentic Systems (Remote)

Zus Health; Boston (MA); Hybrid; USD 210,000 - 280,000; Full time

Benefits offered by this job

Health insurance

401k with match

Unlimited PTO

Competitive compensation

Job summary

Zus Health is seeking a Staff/Principal AI/ML Engineer to define how LLMs and AI agents power our platform. You will own architecture, tooling, and product roadmap, mentoring engineers and delivering production-grade capabilities.

You will build scalable retrieval, RAG, and agent systems over clinical data, ensure safety/compliance, and collaborate with product, sales, and clinical teams to drive impact at scale.

Qualifications

• 7+ years building and shipping AI/ML systems.
• Hands-on depth in modern LLM engineering, including tool use and structured outputs.
• Experience with safety, privacy and reliability when handling clinical data.
• Excellent written and verbal communication with clinicians and product leaders.

Responsibilities

• Architect the LLM platform and shared infra for AI features.
• Build agentic systems that reason over patient data with tool-using agents.
• Own retrieval over clinical data with RAG, embeddings and grounding.
• Establish evaluation pipelines, offline/online evals and CI for models and prompts.
• Drive production CI/CD, observability, and human-in-the-loop feedback loops.
• Prototype with providers, product managers and engineers to ship fast and iterate.
• Set and uphold engineering standards and documentation.

Skills

Python

PyTorch

LLM engineering

Hugging Face

MLOps

Education

BS in Computer Science, Statistics or related field

Tools

AWS

Docker

Kubernetes

CI/CD pipelines

Job description

Zus Health is seeking a Staff/Principal AI/ML Engineer to define how LLMs and AI agents power our platform. You will own architecture, tooling, and product roadmap, mentoring engineers and delivering production-grade capabilities.

You will build scalable retrieval, RAG, and agent systems over clinical data, ensure safety/compliance, and collaborate with product, sales, and clinical teams to drive impact at scale.