Applied AI Platform Lead — Build Production LLMs

openloophealth.com; United States; Remote; USD 180,000 - 260,000; Full time

Benefits offered by this job

Medical, Dental, Vision plans

Flexible Spending/Health Savings

Flexible PTO

401(k) + Company Match

Life Insurance

Pet insurance

Job summary

OpenLoop is hiring a Senior Engineering Manager to build and lead the Applied AI team responsible for shipping LLM-based agents and assistants used by operations, clinical, and patient-facing teams in the United States.

You’ll hire and grow senior engineers, own production AI delivery, and set high architectural and evaluation standards. Strong leadership and security-focused mindset are essential for success in this greenfield space.

Qualifications

• 10+ years of software engineering experience with 3+ years in management.
• Production LLM experience leading real user-facing systems.
• Strong leadership of senior and Staff-level engineers.
• Hands-on understanding of agent runtime, evaluation, retrieval and observability.

Responsibilities

• Build, hire, and grow Applied AI team from a single pod to multiple teams.
• Own roadmap and delivery of production AI agents and assistants used by operations and clinical teams.
• Set technical standards for agent runtime, orchestration, retrieval, model access and observability.
• Create evaluation sets, regression tests and AI-graded evals to measure improvements and catch regressions.
• Ensure operational health of AI systems, including on-call, incident response, and cost management.
• Protect patient data (PHI) and enforce least-privilege access with HIPAA considerations.
• Collaborate with product and operations to prioritize use cases where agents can automate workflows.
• Explain AI capabilities and risks clearly to product, operations, clinical, and exec stakeholders.
• Lead planning, prioritization and delivery rituals to keep a senior team shipping fast.

Skills

Software engineering

People management

LLM / AI systems

Architecture review

Production systems

Security & privacy awareness

Communication

Greenfield work

Education

Bachelor's degree in Computer Science or related field

Tools

Google Cloud (GCP)

Job description

OpenLoop is hiring a Senior Engineering Manager to build and lead the Applied AI team responsible for shipping LLM-based agents and assistants used by operations, clinical, and patient-facing teams in the United States.

You’ll hire and grow senior engineers, own production AI delivery, and set high architectural and evaluation standards. Strong leadership and security-focused mindset are essential for success in this greenfield space.