Senior Applied AI Engineer — Production LLM Systems

OpenLoop Health; United States; Remote; USD 180,000 - 260,000; Full time

Benefits offered by this job

Medical, Dental, Vision

Flexible PTO

401(k) Match

Life & Pet Insurance

Job summary

OpenLoop Health is building the future of healthcare infrastructure and seeks engineers to ship production-grade LLM agents serving real users now. We value depth in agent runtime, evaluation, and observability, plus strong security practices for PHI and sensitive data.

This role spans senior to staff levels, calibrated by scope and depth across AI systems and cross-functional collaboration with product, operations, and clinical stakeholders.

Qualifications

• Bachelor's degree in CS, Engineering or related field.
• 5 to 15+ years of software engineering experience.
• Hands-on production LLM experience in real-user systems.
• Depth in at least one core AI area: agent runtime or evaluation.
• Experience measuring AI systems with evaluation data.
• Strong production engineering fundamentals: testing, debugging, APIs, deployment, on-call.
• Data & Security fluency with a security-first mindset.
• Clear communication with technical and non-technical partners.

Responsibilities

• Ship Production Agents: build and run LLM-based agents used by real users.
• Agent Runtime & Orchestration: manage context, tool calls, retries and sandboxing.
• Evaluation: create test sets and AI-graded evals to track progress.
• Model Access & Operations: manage providers and version upgrades.
• Observability & Cost: trace actions and attribute AI spend.
• Grounding & Retrieval: connect agents to real data via retrieval and prompt design.
• Workflow Design: decide which human steps an agent can perform.
• Security, Privacy & Safety: protect PHI and guard against prompt injection.
• Cloud & Data Foundations: collaborate with GCP and data platforms.
• Raise the Bar: contribute to code/design reviews and help engineers.
• Cross-functional Work: explain AI trade-offs to product/clinical teams.
• Other duties as assigned.

Skills

LLM Production

Agent Runtime

Evaluation

Observability

Security-first

Education

Bachelor's in CS/Engineering

Tools

GCP

Job description

OpenLoop Health is building the future of healthcare infrastructure and seeks engineers to ship production-grade LLM agents serving real users now. We value depth in agent runtime, evaluation, and observability, plus strong security practices for PHI and sensitive data.

This role spans senior to staff levels, calibrated by scope and depth across AI systems and cross-functional collaboration with product, operations, and clinical stakeholders.