Staff Tech Lead — AI/LLM Systems Architect (Hybrid)

OpenLoop Health; United States; Hybrid; USD 180,000 - 230,000; Full time

Benefits offered by this job

M-series Macs

Linear

GitHub

GCP

Equity

Competitive compensation

Job summary

OpenLoop Health is seeking a Technical Lead to own the architecture, execution, and evolution of our AI-driven platform. This senior, hands-on leadership role blends coding with strategic direction as you guide a small, senior engineering team.

You will design distributed systems on GCP, lead AI/LLM integration, and drive reliability, scale, and observability across our healthcare data pipelines. This is a player-coach role with opportunities for growth into management.

Qualifications

• 8+ years of software engineering experience, with 2+ years leading projects or serving as a Tech Lead.
• Strong LLM experience in production environments (hands-on required).
• Deep experience with distributed systems, containerized deployments (Docker, Kubernetes, Cloud Run).

Responsibilities

• Own System Architecture: Design and evolve distributed systems on GCP (Cloud Run, Pub/Sub, BigQuery), making final decisions on service boundaries, data models, and technology trade-offs across Go, Python, and TypeScript.
• AI & LLM Strategy: Lead hands-on integration of AI systems, including open-source LLMs, embeddings, and speech models. Define prompt optimization, evaluation strategies, and safety practices using tools like LangFuse.
• Operational Excellence: Champion observability, reliability, and scale. Oversee event-driven ingestion and automated QA pipelines for call transcripts and healthcare data (FHIR / Medplum).
• Delivery & Execution: Contribute code to critical paths while leading major technical initiatives. Identify gaps, unblock teams, and drive projects to completion.
• Cross-Functional Leadership: Translate complex technical constraints into clear options and trade-offs for Product, Design, and Clinical Operations.

Skills

LLM experience

Distributed systems

Code review

Communication

Tools

Go

Python

TypeScript/Node

Docker

Kubernetes

Cloud Run

Pub/Sub

BigQuery

LangFuse

Job description

OpenLoop Health is seeking a Technical Lead to own the architecture, execution, and evolution of our AI-driven platform. This senior, hands-on leadership role blends coding with strategic direction as you guide a small, senior engineering team.

You will design distributed systems on GCP, lead AI/LLM integration, and drive reliability, scale, and observability across our healthcare data pipelines. This is a player-coach role with opportunities for growth into management.