Senior AI Platform Lead: Architect & Build Production LLMs

OpenLoop; United States; Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

Equity

Competitive compensation

Health benefits

Hybrid Bay Area work model

Macs provided

Job summary

OpenLoop seeks a Technical Lead to own the architecture, execution, and evolution of our AI-driven platform. This senior, hands-on role is a player-coach, writing production code and guiding a small engineering team.

You will design distributed systems on GCP (Cloud Run, Pub/Sub, BigQuery) and lead AI/LLM integration with embeddings and speech models, defining safety practices and deployment strategies.

Qualifications

• 8+ years of software engineering experience, with 2+ years leading projects or as a Tech Lead.
• Staff-level scope or equivalent technical impact.
• Strong LLM experience in production environments (hands-on).
• ML background preferred, especially applied ML or AI infrastructure.

Responsibilities

• Own System Architecture: design distributed systems on GCP (Cloud Run, Pub/Sub, BigQuery).
• AI & LLM Strategy: lead hands-on integration of AI systems, embeddings, speech models, and prompt optimization.
• Operational Excellence: champion observability, reliability, and scale; oversee data pipelines for transcripts and healthcare data (FHIR/Medplum).
• Delivery & Execution: contribute code to critical paths while leading major technical initiatives.

Skills

Go

Python

TypeScript

LLMs

Distributed systems

Kubernetes

Leadership

Cloud Run

Tools

Docker

Kubernetes

GCP

Pub/Sub

BigQuery

Job description

OpenLoop seeks a Technical Lead to own the architecture, execution, and evolution of our AI-driven platform. This senior, hands-on role is a player-coach, writing production code and guiding a small engineering team.

You will design distributed systems on GCP (Cloud Run, Pub/Sub, BigQuery) and lead AI/LLM integration with embeddings and speech models, defining safety practices and deployment strategies.