Staff AI Tech Lead — LLM Systems & Platform (Go/Python/TS)

OpenLoop Health, Inc.; United States; Hybrid; USD 180,000 - 260,000; Full time

Benefits offered by this job

Equity

Flexible Bay Area Hybrid

M-series Macs

Job summary

OpenLoop Health, Inc. is seeking a Technical Lead to own the architecture and evolution of an AI-driven platform.

You will write production code, set technical direction, and coach a small senior engineering team in a pragmatic, hands-on environment. You will lead AI/LLM strategy, integration of open-source models, and ensure reliability, scalability, and compliance for healthcare data in a distributed cloud architecture.

Qualifications

• 8+ years of software engineering experience with 2+ years in project leadership or Tech Lead roles.

Responsibilities

• Own System Architecture: design and evolve distributed systems on GCP (Cloud Run, Pub/Sub, BigQuery).
• Lead AI & LLM Strategy: hands-on integration of AI systems, embeddings, and speech models; define prompt optimization and safety practices.
• Oversee observability, reliability, and scale; manage event-driven ingestion and QA pipelines for transcripts and healthcare data (FHIR/Medplum).
• Contribute code to critical paths while driving major technical initiatives.
• Translate complex constraints into clear options for Product, Design, and Clinical Operations.

Skills

LLM experience

Go

Python

TypeScript/Node

Distributed systems

Docker/Kubernetes

Cloud Run

LangFuse

Tools

LangFuse

BigQuery

Pub/Sub

FHIR

HL7

Ollama

vLLM

Job description

OpenLoop Health, Inc. is seeking a Technical Lead to own the architecture and evolution of an AI-driven platform.

You will write production code, set technical direction, and coach a small senior engineering team in a pragmatic, hands-on environment. You will lead AI/LLM strategy, integration of open-source models, and ensure reliability, scalability, and compliance for healthcare data in a distributed cloud architecture.