AI Model Operations Lead & Routing Architect

Cloudflare, Inc.

New York (NY)

On-site

USD 230,000 - 317,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity participation

Comprehensive benefits

401(k)

Job summary

Cloudflare, Inc. is seeking a senior leader to head the Models team within AI Gateway. You will hire, coach, and grow engineers, own end-to-end model launches, and ensure the catalog aligns with what developers actually receive.

You will steer auto-routing, evaluations, and pricing decisions, while maintaining reliability and governance. You will collaborate with Engineering, Product, Partnerships, and other stakeholders, drive automation, and deliver scalable, trusted model intelligence.

Qualifications

Leadership experience: hire, manage, and grow engineers or operators.
Hands-on ability to write TypeScript, Python, or Rust and read API docs.
Familiarity with models, inference providers, streaming, and tool calling.
SRE mindset: measure health, incidents, and reliability.
Attention to model IDs, context limits, and pricing details.

Responsibilities

Day-Zero launches: ensure new models go live with tested capabilities and pricing.
Catalog reliability: keep catalog in sync with what developers get.
Auto-routing: deliver routing that improves cost/quality.
Developer trust: maintain rankings and recommendations with solid methodology.
Partner & stakeholder management: align Eng, Product, and Partnerships.
Team leadership: provide direction and grow team members.
Operational scalability: reduce manual effort with automation.