Senior Staff Applied AI Engineer - Production LLM Lead

OpenLoop Health; United States; Remote; USD 160,000 - 250,000; Full time

Benefits offered by this job

Medical, Dental, Vision plans

FSA/HSA flexible spending accounts

Flexible PTO

401(k) + Company Match

Life Insurance & Pet insurance

Job summary

OpenLoop Health is building the future of healthcare infrastructure and seeks a Senior Staff Applied AI Engineer to be an early technical leader for AI at OpenLoop. You will shape how AI agents run, prove their quality, and keep them safe and affordable, enabling other teams to build on our platform.

As one of the first hires, you will guide agent runtime, evaluation, model access, observability, and cost control while collaborating with product, operations, and clinical stakeholders to deliver

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related technical field.
• 12+ years of software engineering with leadership at tech lead/principal level.
• 2+ years of production LLM-based systems with real user impact.
• Deep hands-on AI depth across agent runtime, evaluation, and related stacks.
• Proven ability to measure AI quality with evaluation sets and metrics.
• Experience leading a small team in a greenfield project.

Responsibilities

• Set technical direction for agent runtime, tool calls, context management, and sandboxing.
• Build systems to prove AI quality with regression tests and evals.
• Manage model access across providers, versioning, and fallbacks.
• Ensure observability and cost tracking for AI workloads.
• Connect agents to real data via retrieval and prompt engineering.
• Design workflows with operations teams to balance automation and human steps.
• Guard patient data (PHI) and privacy; prevent misuse.
• Make infrastructure decisions on GCP and partner with Data Platform teams.
• Mentor engineers new to AI through code and design reviews.
• Explain AI trade-offs to product, operations, clinical stakeholders.

Skills

Proven Technical Leadership

Production LLM Experience

Core AI Depth

Evaluation Rigor

Zero-to-One Leadership

Communication Skills

Education

Bachelor's degree in Computer Science, Engineering, or related technical field

Tools

GCP

Job description

OpenLoop Health is building the future of healthcare infrastructure and seeks a Senior Staff Applied AI Engineer to be an early technical leader for AI at OpenLoop. You will shape how AI agents run, prove their quality, and keep them safe and affordable, enabling other teams to build on our platform.

As one of the first hires, you will guide agent runtime, evaluation, model access, observability, and cost control while collaborating with product, operations, and clinical stakeholders to deliver