Senior AI Engineer, Healthtech LLM Systems

Dadi Inc (acquired by Ro); New York (NY); On-site; USD 182,000 - 220,000; Full time

Job summary

Ro is building a vertically integrated healthcare platform that connects telehealth, diagnostics, pharmacy, and logistics into a seamless patient experience.

As a Senior Engineer, Applied AI, you will own AI features from prototype through production, crafting orchestration layers, retrieval systems, and evaluation pipelines that scale to real-world clinical use while working with operators and clinicians.

This role offers a high-impact path to improve patient care at scale in New York.

Qualifications

• 5+ years building production software.
• 1–2 years building and deploying LLM-powered apps in production.
• Strong Python backend experience.
• Experience with AI APIs and frameworks.
• Ability to measure quality, reliability, latency, cost, and impact.
• Bonus: LangChain/LangGraph, RAG, vector DBs, observability tools.

Responsibilities

• Design, build, and ship production LLM-powered features end-to-end.
• Build AI application layer: prompt orchestration, tool calling, retrieval, embeddings, agent workflows.
• Develop evaluation infra: regression suites, LLM-as-a-judge, datasets, review workflows, quality metrics.
• Design observability systems: measure accuracy, latency, cost, model behavior.
• Build safety and reliability guardrails for quality and compliance.
• Evaluate/integrate third-party tooling; make build-vs-buy decisions.
• Mentor teammates; raise engineering standards via code reviews.
• Collaborate with clinical operators to understand workflows; iterate based on usage.

Skills

5+ years production software

Python

Backend services

LLM deployment

AI APIs

LangChain

LangGraph

AgentCore

RAG architectures

Vector databases

Tools

LangChain

LangSmith

Arize Phoenix

Braintrust

Job description

Ro is building a vertically integrated healthcare platform that connects telehealth, diagnostics, pharmacy, and logistics into a seamless patient experience.

As a Senior Engineer, Applied AI, you will own AI features from prototype through production, crafting orchestration layers, retrieval systems, and evaluation pipelines that scale to real-world clinical use while working with operators and clinicians.

This role offers a high-impact path to improve patient care at scale in New York.