Forward Deployed Engineer (Mid/Senior) - Remote w/Travel

Bot Jobs; United States; Remote; USD 140,000 - 200,000; Full time

Job summary

Hippocratic AI is seeking a senior software engineer to design and deploy RAG pipelines grounded in healthcare data. You will build tool-calling and Model Context Protocol architectures for secure multi-system interactions with EHRs, data warehouses, and tools while ensuring safety and low latency.

You will develop production Python code using LangChain and LangSmith to implement advanced LLM techniques and manage end-to-end deployments, monitoring, and incident response.

Qualifications

• Bachelor's degree in Computer Science, Software Engineering, or a related technical field.
• 3+ years of professional software engineering experience with strong Python fundamentals and production software development experience.
• Hands-on experience with LLM frameworks (LangChain, LangSmith, or similar) and deep understanding of modern LLM development patterns and best practices.
• Deep expertise in LLM techniques including retrieval-augmented generation (RAG), prompt engineering, tool calling, LLM-as-judge, and related advanced patterns.
• Demonstrated experience building integrations with APIs, databases, or enterprise systems; comfort with async patterns, error handling, and reliability engineering.

Responsibilities

• Design and implement RAG pipelines grounded in healthcare data.
• Build tool-calling and Model Context Protocol architectures for secure multi-system interactions (EHRs, data warehouses, and tools).
• Develop production Python code using LangChain/LangSmith for advanced LLM techniques.
• Execute end-to-end deployments including infrastructure setup, testing, monitoring, and go-live.
• Monitor and own production systems, fix incidents, and collaborate with customers.
• Partner with customers as technical expert, explaining AI system architecture and capabilities.

Skills

Python programming

LLM fundamentals

System design

Education

Bachelor's degree in Computer Science or related field

Tools

LangChain

LangSmith

APIs

Databases

Asynchronous programming

Job description

Location

United States

Employment Type

Full time

Location Type

Remote

Department

Customer Experience; Customer Site Engineering

What You Will Do

• Design and implement RAG pipelines that ground conversational AI responses in customer clinical data, ensuring accuracy, safety, and relevance to healthcare workflows while managing retrieval latency and data governance
• Build tool-calling and Model Context Protocol (MCP) architectures that enable AI agents to interact securely with customer systems—EHRs (Epic, Cerner, Athena), data warehouses, and operational tools—handling errors gracefully and enforcing safety constraints
• Develop production Python code using LangChain, LangSmith, and modern AI frameworks to implement advanced LLM techniques (RAG, prompt engineering, LLM-as-judge, chain-of-thought reasoning) solving novel healthcare AI problems
• Execute end-to-end deployments including infrastructure setup, integration testing, production monitoring configuration, cutover planning, and go-live execution—ensuring deployments happen on schedule without surprises
• Monitor and own production systems by instrumenting deployed agents, responding quickly to incidents, troubleshooting issues collaboratively with customers, and implementing fixes that keep systems running reliably
• Partner with customers as technical expert, explaining AI system architecture, helping teams understand capabilities and limitations, and building confidence in the solution through proactive communication and problem-solving

Location and Travel Requirements

The role can be based in any of the 41 states, except the following:

1. Alaska
2. Connecticut
3. Delaware
4. North Dakota
5. West Virginia
6. New Mexico
7. Hawaii

This role has a travel requirements of 25-40%.

Basic Qualifications

• Bachelor's degree in Computer Science, Software Engineering, or a related technical field
• 3+ years of professional software engineering experience with strong Python fundamentals and production software development experience
• Hands-on experience with LLM frameworks (LangChain, LangSmith, or similar) and deep understanding of modern LLM development patterns and best practices
• Deep expertise in LLM techniques including retrieval-augmented generation (RAG), prompt engineering, tool calling, LLM-as-judge, and related advanced patterns
• Demonstrated experience building integrations with APIs, databases, or enterprise systems; comfort with async patterns, error handling, and reliability engineering

Preferred Qualifications

• Experience with Model Context Protocol (MCP) or similar frameworks for tool integration and multi-system orchestration
• Healthcare IT experience, including EHR integrations (Epic, Cerner, Athena), FHIR, HL7, or healthcare data standards
• Production DevOps or infrastructure experience, including setting up monitoring, alerting, logging, and incident response systems
• Track record deploying AI systems or working with LLMs in production environments, managing latency, reliability, and operational complexity
• Experience in mission-critical or safety-sensitive systems where reliability and error handling are non-negotiable
• Startup or high-growth technology background, particularly in technical leadership or ownership roles

Our comprehensive compensation package is designed to reward your expertise and includes both a competitive base salary and valuable stock options. Individual offers are determined based on a variety of factors, including your professional experience, core competencies, and geographic location.

Why Join Hippocratic AI

Reinvent healthcare with AI that puts safety first. We're building the world's first healthcare‑only, safety‑focused LLM — a breakthrough platform designed to transform patient outcomes at a global scale. This is category creation.

Work with the people shaping the future. Hippocratic AI was co‑founded by CEO Munjal Shah and a team of physicians, hospital leaders, AI pioneers, and researchers from institutions like El Camino Health, Johns Hopkins, Washington University in St. Louis, Stanford, Google, Meta, Microsoft, and NVIDIA.

Backed by the world's leading healthcare and AI investors. We recently raised a $126M Series C at a $3.5B valuation, led by Avenir Growth, bringing total funding to $404M with participation from CapitalG, General Catalyst, a16z, Kleiner Perkins, Premji Invest, UHS, Cincinnati Children's, WellSpan Health, John Doerr, Rick Klausner, and others.

Build alongside the best in healthcare and AI. Join experts who've spent their careers improving care, advancing science, and building world‑changing technologies — ensuring our platform is powerful, trusted, and truly transformative.

Equal Opportunity

Hippocratic AI is an