Senior AI Engineer: Production LLM Architect for Healthcare

Ellipsis Health; San Francisco (CA); Hybrid; USD 160,000 - 210,000; Full time

Benefits offered by this job

401(k) matching

Health insurance

Vision insurance

Dental insurance

Flexible paid time off

Job summary

Ellipsis Health is seeking a senior AI Software Engineer to join the AI Research & Engineering team to build production-ready applications around pre-trained models and agentic systems. You will design scalable architectures, implement evaluation frameworks, and collaborate with clinical, product, and infra teams to deliver safe, low-latency healthcare AI platforms.

You will also contribute to data pipelines, model monitoring, and governance while mentoring other engineers and driving

Qualifications

• Bachelor's degree in CS/Engineering or equivalent practical experience.
• 5+ years of software development with emphasis on product design, core system architecture, and scalable platforms.
• Advanced programming proficiency in Python.
• Proven track record of architecting, implementing, and deploying complex LLM-powered applications, multi-agent orchestration, or autonomous systems.

Responsibilities

• Design, build, and optimize scalable AI systems and orchestration pipelines with multi-step reasoning and long-context evaluation.
• Develop production-ready applications around pre-trained models and implement automated prompt optimization.
• Architect and maintain evaluation frameworks and AI governance with zero-regression tracking.
• Collaborate with clinical, product, and software teams to ensure safe and validated outputs.
• Mentor engineers and raise engineering standards across the team.

Skills

Python

System design

LLM deployment

Distributed systems

Leadership

Education

Bachelor's degree

Master's degree

Tools

PyTorch

JAX

TensorFlow

Job description

Ellipsis Health is seeking a senior AI Software Engineer to join the AI Research & Engineering team to build production-ready applications around pre-trained models and agentic systems. You will design scalable architectures, implement evaluation frameworks, and collaborate with clinical, product, and infra teams to deliver safe, low-latency healthcare AI platforms.

You will also contribute to data pipelines, model monitoring, and governance while mentoring other engineers and driving