Lead AI Platform Engineering — Build Scalable LLM Agents

Health Data Innovations, Inc.; United States; Remote; USD 180,000 - 240,000; Full time

Benefits offered by this job

Medical, Dental, and Vision plans

Flexible Spending/Health Savings

Flexible PTO

401(k) + Company Match

Life Insurance, Pet insurance, and更多

Job summary

OpenLoop is hiring a Senior Engineering Manager to build and lead the Applied AI team responsible for LLM-based agents used by operations, clinical and patient-facing teams. You’ll own production delivery, define architecture standards, and drive reliable, secure AI systems in production.

You’ll guide senior engineers, establish rigorous evaluation, and manage cost and performance while communicating clearly with product and executive stakeholders.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related technical field.
• 10+ years software engineering experience, including 3+ years managing engineers directly.
• Production LLM experience leading systems in production used by real users.
• Senior/Staff-level engineering leadership experience earning technical trust.
• Deep hands-on understanding of agent runtime, evaluation, retrieval and observability for design reviews.
• Experience with production engineering fundamentals: testing, services, APIs, deployment and on-call.
• Data security and privacy fluency with a security-first mindset.
• Comfort building in greenfield space and clear communication with technical and non-technical partners.

Responsibilities

• Build & Lead the Team: Hire, onboard and develop a team of Applied AI Engineers across Senior, Staff and Senior Staff levels and grow from a single pod into multiple teams.
• Own Delivery of Production Agents: Drive roadmap and execution of LLM-based agents used by real users, from scoping to launch to ongoing operation.
• Set the Technical Bar: Partner with Staff+ engineers on architecture for agent runtime, retrieval, observability and model access.
• Evaluation as a Standard: Make evaluation sets and AI-graded evals a required part of shipping.
• Reliability, Cost & Operations: Own operational health of AI systems including on-call, incident response and spend by agent.
• Security, Privacy & Safety: Ensure PHI protection, least-privilege access and HIPAA considerations.
• Workflow & Use Case Prioritization: Align with Product and Operations to prioritize bets and handoffs.
• Cross-functional Leadership: Explain capabilities and risks to non-technical stakeholders.
• Team Health & Process: Run planning and delivery rituals and provide clear feedback.
• Other duties as assigned.

Skills

Engineering Leadership

Production LLM Experience

LLM Architecture

Observability

Security & Privacy

Data Security

Education

Bachelor's degree in CS/Engineering

Tools

GCP

Job description

OpenLoop is hiring a Senior Engineering Manager to build and lead the Applied AI team responsible for LLM-based agents used by operations, clinical and patient-facing teams. You’ll own production delivery, define architecture standards, and drive reliable, secure AI systems in production.

You’ll guide senior engineers, establish rigorous evaluation, and manage cost and performance while communicating clearly with product and executive stakeholders.