Senior LLM Infra Engineer Scalable AI Agents

Harrison Clarke; San Francisco (CA); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Competitive compensation package

Significant technical ownership

Meaningful equity

Job summary

Harrison Clarke seeks an exceptional LLM Infrastructure Engineer in San Francisco to design and scale systems for autonomous AI agents. You'll develop scalable agent execution runtimes, work on orchestration systems for multi-agent workflows, and optimize LLM deployments.

The role includes significant technical ownership with a competitive compensation package, including meaningful equity, and offers the chance to work with top-tier engineers from leading AI labs.

Qualifications

• Strong software engineering fundamentals with expertise in distributed systems and backend infrastructure.
• Deep understanding of modern LLM architectures and inference workflows.
• Strong knowledge of cloud infrastructure, Kubernetes, containerization, and production deployment practices.

Responsibilities

• Design and build highly scalable agent execution runtimes capable of handling millions of model invocations.
• Develop orchestration systems for multi-agent workflows.
• Create reliable execution frameworks for tool use and function calling.

Skills

Strong software engineering fundamentals

Distributed systems expertise

Experience in Python, Go, Rust

Knowledge of cloud infrastructure

Experience with Kubernetes

Job description

Harrison Clarke seeks an exceptional LLM Infrastructure Engineer in San Francisco to design and scale systems for autonomous AI agents. You'll develop scalable agent execution runtimes, work on orchestration systems for multi-agent workflows, and optimize LLM deployments.

The role includes significant technical ownership with a competitive compensation package, including meaningful equity, and offers the chance to work with top-tier engineers from leading AI labs.