Senior AI/LLM Engineer (Remote Backend)

UpDoc; United States; On-site; USD 140,000 - 210,000; Full time

Job summary

UpDoc is building the first clinically validated, physician-supervised AI assistant to manage chronic diseases. We are an early-stage startup, founded by Stanford physicians, seeking a senior backend engineer to join remotely and work on our patient-facing conversational agent.

You will own the backend stack, implement scalable voice/multimodal conversations, and collaborate with clinicians to ensure medical accuracy while delivering reliable AI experiences.

Qualifications

• 5+ years of professional software development experience, including 2+ years of backend web development.
• Proficient in type-hinted, modern Python.
• 2+ years building end-to-end LLM applications.
• Experience integrating LLMs in production environments.
• Knowledge of evaluation frameworks.
• Knowledge and experience with MLOps/LLMOps best practices.
• Experience building AI infrastructure from 0 -> 1.
• Experience with cloud platforms (especially Azure) and containerization technologies.

Responsibilities

• Lead the development of our patient-facing conversational agent.
• Implement a scalable, low-latency system for voice/multimodal conversations.
• Implement rigorous prompt engineering processes and develop useful metrics for system evaluation.
• Identify where fine-tuning and alignment might be valuable, and create data pipelines to enable fast experimentation.
• Work with other backend engineers to deploy AI models and chat/voice APIs.
• Help identify, evaluate, and implement emerging LLM technologies, tools and frameworks.
• Collaborate with clinical experts to validate performance and medical accuracy.
• Work on developing backend services using FastAPI and Pydantic.

Skills

Backend development

Python

LLM apps

Type hints

ML pipelines

Tools

FastAPI

Pydantic

Azure

Containers

LLMOps

Job description

UpDoc is building the first clinically validated, physician-supervised AI assistant to manage chronic diseases. We are an early-stage startup, founded by Stanford physicians, seeking a senior backend engineer to join remotely and work on our patient-facing conversational agent.

You will own the backend stack, implement scalable voice/multimodal conversations, and collaborate with clinicians to ensure medical accuracy while delivering reliable AI experiences.