Lead, AI Gateway Model Operations

Cloudflare, Inc.

San Francisco (CA)

On-site

USD 230,000 - 317,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health insurance
401(k) Retirement Plan
Employee stock participation
Flexible paid time off

Job summary

Cloudflare in San Francisco, CA is seeking a Model Operations Lead for AI Gateway. You will build and lead the models team, manage day-zero launches, and ensure pricing, metering, and routing are correct. You will own evaluations, capability maps, and per-task rankings behind auto-routing profiles, and translate learnings into roadmap input.

This is a hands-on leadership role with coding expectations. The role reports to the AI Gateway Engineering Manager and offers a competitive compensation

Qualifications

  • Experience hiring, managing, and growing engineers or operators.
  • Hands-on ability to write TypeScript, Python, or Rust, read API docs, and debug using terminal tools.
  • Deep familiarity with new models, labs, and inference providers; streaming, tool calling, and pricing considerations.

Responsibilities

  • Day-Zero launches: ensure new models go live with tested capabilities, pricing, docs, and routing eligibility.
  • Catalog reliability: keep published capabilities and prices aligned with what developers get.
  • Auto-routing: deliver improvements in cost/quality via routing profiles and rankings.
  • Developer trust: maintain trusted rankings and deterministic checks for model outputs.
  • Partner & stakeholder management: align with Engineering, Product, Partnerships, and other teams.
  • Team leadership: provide ownership and growth paths for the team and manage delivery of launches.
  • Operational scalability: reduce manual effort through automation and tooling.

Skills

People leadership
Technical shipping
Model ecosystem
Product mindset
Agent workflows

Tools

TypeScript
Python
Rust

Job description

Cloudflare in San Francisco, CA is seeking a Model Operations Lead for AI Gateway. You will build and lead the models team, manage day-zero launches, and ensure pricing, metering, and routing are correct. You will own evaluations, capability maps, and per-task rankings behind auto-routing profiles, and translate learnings into roadmap input.

This is a hands-on leadership role with coding expectations. The role reports to the AI Gateway Engineering Manager and offers a competitive compensation

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead, AI Gateway Model Operations
Lead, AI Gateway Model Operations

WebHosting • Austin (TX), New York (NY), San Francisco (CA)

On-site
USD 270,000 - 303,000
Equity in Cloudflare
Comprehensive benefits
AI Model Operations Lead & Routing Architect
AI Model Operations Lead & Routing Architect

Cloudflare, Inc. • New York (NY)

On-site
USD 230,000 - 317,000
Equity participation
Comprehensive benefits
401(k)
Senior AI Gateway Systems Engineer
Senior AI Gateway Systems Engineer

Cloudflare, Inc. • New York (NY)

On-site
USD 185,000 - 254,000
401(k)
Stock options
Medical Insurance
+1
Senior Engineering Manager, AI
Senior Engineering Manager, AI

Alphasense • United States

Remote
USD 300,000 - 600,000
Equity
Benefits program
Senior AI Gateway and Systems Engineering Lead
Senior AI Gateway and Systems Engineering Lead

Alphasense • United States

Remote
USD 300,000 - 600,000
Equity
Benefits program
Lead ML Engineer & AI Platform Architect
Lead ML Engineer & AI Platform Architect

Cloudflare, Inc. • San Francisco (CA)

Hybrid
USD 190,000 - 260,000
Health Insurance
Dental Insurance
Vision Insurance
+2
Senior AI Gateway Systems Engineer
Senior AI Gateway Systems Engineer

Cloudflare, Inc. • New York (NY)

On-site
USD 185,000 - 254,000
Equity plan
Health & welfare benefits
401(k) retirement plan
+1
Senior AI Gateway Systems Engineer (Edge Infra) Equity
Senior AI Gateway Systems Engineer (Edge Infra) Equity

FDE Times • Austin (TX), New York (NY), San Francisco (CA)

On-site
USD 170,000 - 230,000
Medical Insurance
Dental Insurance
Vision Insurance
+3
Senior AI Gateway Engineer — Edge Inference
Senior AI Gateway Engineer — Edge Inference

Cloudflare, Inc. • San Francisco (CA)

On-site
USD 194,000 - 266,000
Medical Insurance
Dental Insurance
Vision Insurance
+5
Lead AI & Cloud Engineering Manager
Lead AI & Cloud Engineering Manager

present of AI • San Francisco (CA)

On-site
USD 180,000 - 270,000
Competitive salary
Stock options
Medical insurance