Senior AI Engineer - Health Tech & Telehealth

MD Ally; United States; Remote; USD 150,000 - 250,000; Full time

Benefits offered by this job

Salary and equity package

Full medical, dental & vision coverage

401(k) plan and flexible PTO

Job summary

MD Ally seeks a Senior AI Engineer to architect, build, and scale production AI systems for clinical use. You will implement HIPAA‑compliant data pipelines, guardrails, and real‑time speech/text processing integrated into telehealth and EHRs.

You’ll own ambient transcription, EHR read/write agents, and RAG‑based chart summarization, plus patient intake, triage routing, and post‑visit care plan automation with secure, auditable software.

Qualifications

• 5+ years of software engineering experience, with 2+ years shipping production LLM, NLP, or speech‑to‑text applications.
• Strong Engineering Fundamentals: High proficiency in Python and TypeScript/Node.js, with API design, state machines, asynchronous workers, and CI/CD.
• Hands‑On Applied AI Stack: Practical experience with LLM orchestration frameworks, RAG pipelines, vector databases, and structured output validation.
• Security and Privacy Mindset: Experience building HIPAA/SOC2 compliant systems with BAAs and encrypted data flows.
• Cross‑Functional Collaboration: Partner with clinicians, product managers, and security teams to translate medical protocols into deterministic software.

Responsibilities

• Architect and scale production AI systems handling PHI with auditable, private pipelines.
• Build ambient clinical scribes and EHR read/write agents using standards like FHIR/HL7.
• Develop retrieval‑augmented generation systems to summarize complex medical records with source citations.
• Create dynamic symptom intake, triage routing, and post‑visit care plan automation.
• Implement guardrails, audit logs, and real‑time streaming for telehealth workflows.

Skills

Python

TypeScript/Node.js

APIs design

CI/CD

LLM orchestration

RAG pipelines

Vector databases

Security & privacy

Cross‑functional collaboration

Tools

LangGraph

LlamaIndex

Custom agent harnesses

pgvector

Pinecone

Job description

MD Ally seeks a Senior AI Engineer to architect, build, and scale production AI systems for clinical use. You will implement HIPAA‑compliant data pipelines, guardrails, and real‑time speech/text processing integrated into telehealth and EHRs.

You’ll own ambient transcription, EHR read/write agents, and RAG‑based chart summarization, plus patient intake, triage routing, and post‑visit care plan automation with secure, auditable software.