Applied AI Engineer — Production LLMs for Healthcare

OpenLoop; United States; On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Medical, Dental, Vision

FSA/HSA

Flexible PTO

401(k) + Company Match

Life Insurance

Pet Insurance

Job summary

OpenLoop is building the future of healthcare infrastructure with scalable LLM-powered agents and AI workflows. We hire at Senior, Staff and Senior Staff levels and calibrate level based on scope and depth brought, not years alone.

You will design, deploy and monitor production AI solutions, collaborating across product, operations and clinical stakeholders while ensuring security and PHI protection in every AI system.

Qualifications

• Bachelor's degree in CS, engineering or related field.
• 5–15+ years of software engineering experience.
• Production LLM experience with real user deployments.
• Core AI depth in agent runtime, evaluation, retrieval or observability.
• Experience measuring AI systems with evaluation data.
• Strong production engineering across testing, debugging, APIs, deployment.
• Experience handling sensitive data with security-first mindset.
• Clear communication with technical and non-technical partners.

Responsibilities

• Ship Production Agents: build and run reliable LLM-based agents.
• Agent Runtime & Orchestration: manage context, calls, retries, timeouts.
• Evaluation: create test sets, regression tests, AI-graded evals.
• Model Access & Operations: manage providers and versioning.
• Observability & Cost: trace actions, monitor production behavior.
• Grounding & Retrieval: connect to real data via RAG and prompting.
• Workflow Design: decide what steps an agent handles vs. escalation.
• Security, Privacy & Safety: protect PHI, restrict access, prevent abuse.
• Cloud & Data Foundations: build on GCP with data platform teams.
• Cross-functional: explain AI trade-offs to product/clinical teams.

Skills

Production LLMs

Agent runtime

Evaluation rigor

Security mindset

Greenfield work

Cross-functional comms

Team leadership

Deployment & on-call

Education

Bachelor's degree in Computer Science, Engineering, or a related technical field

Tools

Google Cloud Platform (GCP)

Job description

OpenLoop is building the future of healthcare infrastructure with scalable LLM-powered agents and AI workflows. We hire at Senior, Staff and Senior Staff levels and calibrate level based on scope and depth brought, not years alone.

You will design, deploy and monitor production AI solutions, collaborating across product, operations and clinical stakeholders while ensuring security and PHI protection in every AI system.