Senior AI Gateway Engineer — Edge Inference

CloudFlare; San Francisco (CA); On-site; USD 194,000 - 266,000; Full time

Benefits offered by this job

Medical Insurance

Dental Insurance

Vision Insurance

Flexible Spending Accounts

Commuter Benefits

401(k) Retirement Savings Plan

Employee Stock Plan

Flexible PTO

Job summary

Cloudflare is hiring a Senior Systems Engineer for AI Gateway in Austin, TX or San Francisco, CA. You will build a scalable AI inference layer at the edge, design APIs and developer workflows, and collaborate across teams to ship production-ready platforms.

You should have 5+ years of experience in AI infrastructure, distributed systems, and developer tools, with strong APIs and observability skills. This role includes equity and a comprehensive US benefits package.

Qualifications

• 5+ years of experience building and operating production systems, ideally in AI infrastructure, developer platforms, cloud infrastructure, edge/proxy systems, high-scale APIs, or distributed systems.

Responsibilities

• Build core AI Gateway systems that handle high-volume inference traffic across providers, models, and Cloudflare's global network.
• Design and implement APIs, routing primitives, observability features, controls, and developer workflows that make AI Gateway reliable and easy to adopt.
• Work across product and infrastructure boundaries with Workers AI, Agents, and the broader Developer Platform organization to make Cloudflare's AI platform feel like one coherent product.
• Turn ambiguous product and technical ideas into prototypes, design docs, shipped features, and measurable production improvements.
• Improve reliability, performance, cost efficiency, and debuggability for latency-sensitive AI workloads.
• Build the software and the software that builds the software: agents, tests, harnesses, evaluation loops, operational tools, and internal context that help the team move faster with confidence.
• Sweat the developer experience. Error messages, SDKs, dashboard flows, docs, examples, and API details all matter.
• Mentor other engineers through design review, code review, debugging, and technical leadership without needing people-management authority.
• Bring strong opinions, clear judgment, and a willingness to revise your view when data, users, or production reality prove otherwise.

Skills

AI infrastructure

Developer platforms

Cloud infrastructure

Edge/proxy systems

High-scale APIs

Distributed systems

APIs

TypeScript

Go

Rust

Tools

TypeScript

Go

Rust

Job description

Cloudflare is hiring a Senior Systems Engineer for AI Gateway in Austin, TX or San Francisco, CA. You will build a scalable AI inference layer at the edge, design APIs and developer workflows, and collaborate across teams to ship production-ready platforms.

You should have 5+ years of experience in AI infrastructure, distributed systems, and developer tools, with strong APIs and observability skills. This role includes equity and a comprehensive US benefits package.