Senior AI Engineer - Healthcare Conversational Agents

Ellipsis Health; San Francisco (CA); On-site; USD 160,000 - 210,000; Full time

Job summary

Ellipsis Health is hiring a Senior Software Engineer on our provider engineering team to build AI agents that health systems deploy with patients. You’ll own end-to-end agent work—from conversation design and prompts to tool calls, evals, and the APIs that run in production.

In this full-time, on-site San Francisco role, you will ship multiple production agents within three months, iterate based on live conversations, and collaborate with product, clinical, deployment, and customer teams to turn

Qualifications

• 5+ years of professional software engineering experience, including 1+ year building and shipping LLM-powered applications in production.
• Strong proficiency in Python and/or TypeScript, comfortable across backend APIs and data, with enough frontend to ship a complete feature.
• Hands-on experience with prompting, tool use and function calling, RAG, structured outputs, and agent orchestration.
• Experience designing evals and using data to decide what to fix next.
• Product sense: you care whether the patient got their appointment booked, not just whether the model metric moved.
• Clear written and verbal communication with technical and non-technical teammates.

Responsibilities

• Design, build, and ship AI agents end to end, including conversation flows, prompts, tool and function calling, retrieval, memory, and the backend services agents depend on.
• Build evaluation systems (offline test suites, simulated conversations, human review loops, and production monitoring) so we know an agent is good before and after it ships.
• Improve instruction following, tool-calling reliability, latency, and cost across our LLM and speech stack.
• Help design and build our next-generation voice agent platform, choosing the right models and architecture for each task based on quality, latency, and cost.
• Partner with clinical, product, and customer teams to turn workflows into reliable agent behavior.
• Dig into real conversations and failure cases, and close the loop with prompt, tool, model, or product changes.
• Build internal tools to observe, monitor, and analyze agent behavior at scale to identify common failure modes and patterns.
• Track what's new in models and tooling, and bring the useful parts into production quickly.

Skills

Python

TypeScript

LLM workflows

Prompting

Tool invocation

APIs

Communication

Tools

Twilio

WebRTC

Temporal

Job description

Ellipsis Health is hiring a Senior Software Engineer on our provider engineering team to build AI agents that health systems deploy with patients. You’ll own end-to-end agent work—from conversation design and prompts to tool calls, evals, and the APIs that run in production.

In this full-time, on-site San Francisco role, you will ship multiple production agents within three months, iterate based on live conversations, and collaborate with product, clinical, deployment, and customer teams to turn