Lead, AI Gateway Model Operations

WebHosting; Austin, New York, San Francisco (TX, NY, CA); On-site; USD 270,000 - 303,000; Full time

Benefits offered by this job

Equity in Cloudflare

Comprehensive benefits

Job summary

Cloudflare seeks a Senior Operations leader for AI Gateway to build and lead the models team, oversee end-to-end model launches, and ensure catalog accuracy. You’ll drive model intelligence, routing decisions, and vendor partner coordination while managing a growing group of engineers and operators.

You’ll own operational cadence, automate repetitive launches, and work closely with Engineering, Product, and Partnerships to scale the model catalog and pricing.

Qualifications

• Experience hiring, managing, and growing engineers or operators.
• Hands-on ability to write TypeScript, Python, or Rust, read API docs, inspect endpoints, and debug using terminal tools.
• Deep familiarity with model labs, inference providers, and cataloging.
• Data-driven product instincts and SRE mindset for reliability and scalability.
• Daily experience building with agents and verifying deterministic outputs.

Responsibilities

• Day-Zero & Quality Launches: ensure new models launch with tested capabilities, pricing, docs and routing eligibility.
• Catalog Reliability & Health: keep the catalog aligned with what customers get and detect issues early.
• Auto-Routing & Optimization: deliver auto-routing that beats fixed model choices on cost or quality.
• Developer Trust & Methodology: maintain trusted rankings and recommendations with solid methods.
• Partner & Stakeholder Management: align Engineering, Product, Partnerships and others.
• Team Leadership & Growth: provide ownership and direction for future growth.
• Operational Scalability: reduce manual effort via tools and automation.

Skills

People leadership

Hands-on coding

Model ecosystem

Product & SRE mindset

Agent workflows

Tools

TypeScript

Python

Rust

Job description

Cloudflare seeks a Senior Operations leader for AI Gateway to build and lead the models team, oversee end-to-end model launches, and ensure catalog accuracy. You’ll drive model intelligence, routing decisions, and vendor partner coordination while managing a growing group of engineers and operators.

You’ll own operational cadence, automate repetitive launches, and work closely with Engineering, Product, and Partnerships to scale the model catalog and pricing.