Senior AI Engineer, Healthcare Conversational Agents

Ellipsis Health; New York (NY); Hybrid; USD 160,000 - 210,000; Full time

Benefits offered by this job

Health, dental, and vision insurance

401(k) plan

Learning budget / conferences

Job summary

Ellipsis Health is seeking a Senior Software Engineer to build AI agents that converse with patients. You will own the end-to-end system from conversation design to tool calls and production APIs, delivering multiple production agents within the first months.

You will work with product, clinical, deployment, and commercial teams to ship robust agent workflows, eval suites, and continuous improvements using live conversation data.

Qualifications

• 5+ years of professional software engineering experience.
• Strong proficiency in Python and/or TypeScript.
• Hands-on experience with prompting, tool use and function calling, RAG, structured outputs, and agent orchestration.
• Experience designing evals and using data to decide what to fix next.
• Product sense: you care whether the patient got their appointment booked, not just whether the model metric moved.
• Clear written and verbal communication with technical and non-technical teammates.

Responsibilities

• Design, build, and ship AI agents end to end, including conversation flows, prompts, tool and function calling, retrieval, memory, and the backend services agents depend on.
• Build evaluation systems (offline test suites, simulated conversations, human review loops, and production monitoring) so we know an agent is good before and after it ships.
• Improve instruction following, tool-calling reliability, latency, and cost across our LLM and speech stack.
• Help design and build our next-generation voice agent platform, choosing the right models and architecture for each task based on quality, latency, and cost.
• Partner with clinical, product, and customer teams to turn workflows into reliable agent behavior.
• Dig into real conversations and failure cases, and close the loop with prompt, tool, model, or product changes.
• Build internal tools to observe, monitor, and analyze agent behavior at scale to identify common failure modes and patterns.
• Track what's new in models and tooling, and bring the useful parts into production quickly.

Skills

5+ years experience

Python/TypeScript

Prompting/tool use/LLM orchestration

Designing evals with data

Product sense

Clear communication

Tools

Temporal

Job description

Ellipsis Health is seeking a Senior Software Engineer to build AI agents that converse with patients. You will own the end-to-end system from conversation design to tool calls and production APIs, delivering multiple production agents within the first months.

You will work with product, clinical, deployment, and commercial teams to ship robust agent workflows, eval suites, and continuous improvements using live conversation data.