Senior AI Gateway Systems Engineer

Webhosting; Town of Texas (WI); On-site; USD 194,000 - 266,000; Full time

Job summary

Cloudflare is seeking a Senior Systems Engineer to build and operate the AI Gateway at the network edge. You will work across the stack from distributed systems to developer-facing workflows, helping define how AI applications run on Cloudflare’s platform.

You will contribute to APIs, observability, and tooling, while collaborating with Workers AI, Agents, and the Developer Platform to deliver a cohesive AI platform experience. 5+ years of production systems experience is required.

Qualifications

• 5+ years of experience building and operating production systems, ideally in AI infrastructure, developer platforms, cloud infrastructure, edge/proxy systems, high-scale APIs, or distributed systems.
• Strong systems engineering fundamentals: networking, APIs, reliability, observability, data modeling, performance, and operational tradeoffs.
• Experience designing or scaling distributed systems where latency, throughput, availability, and correctness all matter.

Responsibilities

• Build core AI Gateway systems that handle high-volume inference traffic across providers, models, and Cloudflare’s global network.
• Design and implement APIs, routing primitives, observability features, controls, and developer workflows that make AI Gateway reliable and easy to adopt.
• Work across product and infrastructure boundaries with Workers AI, Agents, and the broader Developer Platform organization to make Cloudflare’s AI platform feel like one coherent product.
• Turn ambiguous product and technical ideas into prototypes, design docs, shipped features, and measurable production improvements.
• Improve reliability, performance, cost efficiency, and debuggability for latency-sensitive AI workloads.

Skills

Distributed systems

APIs

Observability

Reliability

Performance

TypeScript

Go

Rust

Dashboards

SDKs

Tools

SDKs

Dashboards

CLI

Agent frameworks

Job description

Cloudflare is seeking a Senior Systems Engineer to build and operate the AI Gateway at the network edge. You will work across the stack from distributed systems to developer-facing workflows, helping define how AI applications run on Cloudflare’s platform.

You will contribute to APIs, observability, and tooling, while collaborating with Workers AI, Agents, and the Developer Platform to deliver a cohesive AI platform experience. 5+ years of production systems experience is required.