Senior Backend AI Engineer — Remote, LLM & Medical AI

UpDoc, Inc.; United States; On-site; USD 140,000 - 190,000; Full time

Job summary

UpDoc, Inc. is building a physician-supervised medical AI assistant. We seek a senior engineer with a backend tilt to own our patient-facing conversational agent and scalable AI infrastructure. This fully remote role focuses on end-to-end LLM applications, evaluation, and collaboration with clinicians to ensure medical accuracy.

You will develop backend services with FastAPI, deploy AI models and APIs, and explore emerging LLM technologies in a fast-paced startup environment.

Qualifications

• 5+ years of professional software development experience, including 2+ years backend web development.
• Proficient with type-hinted, modern Python.
• 2+ years building end-to-end LLM applications, personally or professionally.
• Experience integrating/optimizing LLMs in production environments.
• Knowledge of evaluation frameworks.
• Knowledge and experience with MLOps/LLMOps best practices.
• Experience building AI infrastructure from 0 -> 1.

Responsibilities

• Lead the development of our patient-facing conversational agent.
• Implement a scalable, low-latency system for voice/multimodal conversations.
• Implement rigorous prompt engineering processes and develop useful metrics for system evaluation.
• Identify where fine-tuning and alignment might be valuable, and create data pipelines to enable fast experimentation.
• Work with other backend engineers to deploy AI models and chat/voice APIs.
• Help identify, evaluate, and implement emerging LLM technologies, tools and frameworks.
• Collaborate with clinical experts to validate performance and medical accuracy.
• Work on developing backend services using FastAPI and Pydantic.

Skills

Backend web development

Python (type-hinted)

LLM applications

Cloud platforms (Azure)

Containerization (Docker)

Tools

FastAPI

Pydantic

Job description

UpDoc, Inc. is building a physician-supervised medical AI assistant. We seek a senior engineer with a backend tilt to own our patient-facing conversational agent and scalable AI infrastructure. This fully remote role focuses on end-to-end LLM applications, evaluation, and collaboration with clinicians to ensure medical accuracy.

You will develop backend services with FastAPI, deploy AI models and APIs, and explore emerging LLM technologies in a fast-paced startup environment.