Head of Applied AI Engineering (Production LLMs)

OpenLoop; United States; On-site; USD 180,000 - 280,000; Full time

Benefits offered by this job

Medical, Dental, and Vision plans

401(k) + Company Match

Flexible PTO

Job summary

OpenLoop is hiring a Senior Engineering Manager to build and lead our Applied AI team focused on LLM-based agents used across patient care workflows. You will hire senior engineers, define production standards, and partner with security and compliance to protect PHI data.

You will own delivery of production AI systems, set technical bar, drive evaluation rigor, and manage on-call and incidents while balancing costs.

Qualifications

• Bachelor's degree in CS or related field.
• 10+ years software engineering, incl. 3+ years managing engineers.
• Production LLM experience with real users.
• Senior/Staff-level engineering leadership experience.
• Hands-on understanding of agent runtime, retrieval & observability.
• Experience in security-first handling of sensitive data.
• Strong communication with technical and non-technical partners.

Responsibilities

• Build & Lead the Team: Hire, onboard and grow Applied AI Engineers across multiple levels.
• Own Delivery of Production Agents: Drive roadmap and execution from scoping to launch.
• Set the Technical Bar: Define architecture, runtime, retrieval, observability trade-offs.
• Evaluation as a Standard: Create evaluation sets and AI-graded evals to measure improvements.
• Reliability, Cost & Operations: Own on-call, incidents, fallbacks, and spend management.
• Security, Privacy & Safety: Ensure PHI protection and HIPAA compliance.
• Workflow & Use Case Prioritization: Align with product/ops on bets and handoffs.
• Cross-functional Leadership: Explain AI capabilities and risks to stakeholders.
• Team Health & Process: Run planning and reviews with clear feedback and growth paths.
• Other duties as assigned.

Skills

Engineering leadership

Software engineering

Team management

LLM experience

Architectural review

Evaluation methods

Security mindset

Communication

Greenfield projects

Education

Bachelor's degree in Computer Science or related

Tools

GCP

Agent runtime

Observability tooling

Job description

OpenLoop is hiring a Senior Engineering Manager to build and lead our Applied AI team focused on LLM-based agents used across patient care workflows. You will hire senior engineers, define production standards, and partner with security and compliance to protect PHI data.

You will own delivery of production AI systems, set technical bar, drive evaluation rigor, and manage on-call and incidents while balancing costs.