Senior AI Engineer — Production LLMs & Agent Orchestration

Openloop-Health; Des Moines (IA); Hybrid; USD 180,000 - 260,000; Full time

Benefits offered by this job

Medical Insurance

Flexible PTO

401(k) + Company Match

Life Insurance

Pet insurance

Job summary

OpenLoop seeks engineers to build production-grade LLM-based agents for healthcare AI infrastructure. You will work across model providers, evaluation, retrieval, and observability, ensuring secure handling of patient data while collaborating with product and clinical teams.

The role is open at Senior, Staff, and Senior Staff levels with calibration during the process based on scope and depth you bring. Strong cloud and systems skills are essential.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related technical field.
• 5 to 15+ years of software engineering experience.
• Hands-on Production LLM experience with real users.
• Depth in agent runtime, evaluation, retrieval, or observability & cost.
• Experience measuring AI systems with evaluation data.
• Strong production engineering across testing, debugging, services and APIs.
• Experience handling sensitive data with a security-first mindset.

Responsibilities

• Ship Production Agents: build and run LLM-based agents that real users rely on.
• Agent Runtime & Orchestration: run, call tools, manage context, handle timeouts and sandboxing.
• Evaluation: create tests and evals to quantify improvements.
• Model Access & Operations: manage multiple model providers and version upgrades.
• Observability & Cost: trace actions, monitor production behavior and AI spend.
• Grounding & Retrieval: connect agents to real data via retrieval and prompt design.
• Workflow Design: decide steps an agent can do vs escalation to humans.
• Security, Privacy & Safety: protect PHI and defend against misuse.
• Cloud & Data Foundations: build on GCP with data platform teams.
• Raise the Bar: participate in code/design reviews and mentor others.
• Cross-functional Communication: explain AI trade-offs to non-technical partners.
• Other duties as assigned.

Skills

Senior Software Eng

Production LLM

AI Depth

Evaluation Rigor

Engineering Fundamentals

Data Security

Greenfield Mindset

Education

Bachelor's degree in CS/Engineering

Tools

GCP

Model Versioning

Retrieval (RAG)

Job description

OpenLoop seeks engineers to build production-grade LLM-based agents for healthcare AI infrastructure. You will work across model providers, evaluation, retrieval, and observability, ensuring secure handling of patient data while collaborating with product and clinical teams.

The role is open at Senior, Staff, and Senior Staff levels with calibration during the process based on scope and depth you bring. Strong cloud and systems skills are essential.