AI Infrastructure Engineer — Performance & Systems

Harrison Clarke

San Francisco (CA)

On-site

USD 180,000 - 260,000

Full time

6 days ago
Be an early applicant
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Harrison Clarke is partnering with an early‑stage AI infrastructure company to hire a highly technical Machine Learning Engineer. This hands‑on role sits at the intersection of LLM systems, AI agents, inference and performance engineering, focusing on production workloads and system optimization.

You’ll contribute across AI infrastructure, agent systems, inference optimization, distributed execution and runtime performance, tackling bottlenecks and shaping the architecture as one of the first

Qualifications

  • Strong software engineering and computer science fundamentals.
  • Experience building complex production systems.
  • Depth in distributed systems, performance engineering, runtimes, databases, compilers, or AI infrastructure.
  • Meaningful experience with modern LLM or agent systems.
  • Ability to operate across multiple layers of the stack.
  • Comfortable in a highly ambiguous, early‑stage environment.

Responsibilities

  • Design and build infrastructure for production AI and agent workloads.
  • Improve the performance, efficiency and reliability of AI systems.
  • Work across inference, execution, runtime and distributed systems challenges.
  • Identify bottlenecks across complex production workloads and develop systems‑level solutions.
  • Build new infrastructure from first principles rather than simply integrating existing tools.
  • Help shape core technical architecture as one of the earliest engineers.

Skills

Strong software engineering
Production systems
Distributed systems
Performance engineering
AI infrastructure
Ownership mindset

Job description

Harrison Clarke is partnering with an early‑stage AI infrastructure company to hire a highly technical Machine Learning Engineer. This hands‑on role sits at the intersection of LLM systems, AI agents, inference and performance engineering, focusing on production workloads and system optimization.

You’ll contribute across AI infrastructure, agent systems, inference optimization, distributed execution and runtime performance, tackling bottlenecks and shaping the architecture as one of the first

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Infrastructure Engineer — Build Scale Training & Serving
ML Infrastructure Engineer — Build Scale Training & Serving

Harrison Clarke • San Francisco (CA)

On-site
USD 180,000 - 280,000
Machine Learning Engineer
Machine Learning Engineer

Harrison Clarke • San Francisco (CA)

On-site
USD 180,000 - 260,000
Senior LLM Infra Engineer Scalable AI Agents
Senior LLM Infra Engineer Scalable AI Agents

Harrison Clarke • San Francisco (CA)

On-site
USD 120,000 - 160,000
Competitive compensation package
Significant technical ownership
Meaningful equity
Staff Software Engineer, AI Infrastructure
Staff Software Engineer, AI Infrastructure

Harrison Clarke • San Francisco (CA)

On-site
USD 120,000 - 160,000
Competitive compensation package
Significant technical ownership
Meaningful equity
AI-Native Senior Software Engineer - Equity & Impact
AI-Native Senior Software Engineer - Equity & Impact

Harrison Clarke • San Mateo (CA)

Hybrid
USD 250,000 - 300,000
Senior AI Platform Engineer - Build 24/7 Agent Workflows
Senior AI Platform Engineer - Build 24/7 Agent Workflows

Harrison Clarke • San Francisco (CA)

On-site
USD 220,000 - 400,000
AI Agent Architect — Build Production-Grade End-to-End Agents
AI Agent Architect — Build Production-Grade End-to-End Agents

Harrison Clarke • San Francisco (CA)

On-site
USD 120,000 - 150,000
ML-Driven Infra Engineer: Scale Data Pipelines & Models
ML-Driven Infra Engineer: Scale Data Pipelines & Models

Harrison Clarke • San Francisco (CA)

On-site
USD 120,000 - 160,000
ML Software Engineer — AI Safety & Production NLP
ML Software Engineer — AI Safety & Production NLP

Harrison Clarke • San Francisco (CA)

On-site
USD 140,000 - 210,000
AI/ML Engineer — LLM Infra & Agentic Workflows
AI/ML Engineer — LLM Infra & Agentic Workflows

Objective Partners • New York (NY)

On-site
USD 150,000 - 260,000
Medical, dental, vision insurance
High-performance hardware access
Competitive base + incentive options