Senior AI Infrastructure Engineer (Edge & Gateway)

Worky; Austin (TX); On-site; USD 140,000 - 200,000; Full time

Job summary

Cloudflare is seeking a Senior Systems Engineer to build AI Gateway at the edge, enabling high-volume model inference with reliable, observable infrastructure. You will prototype across the stack—from APIs to dashboards—and work with Workers AI, Agents, and the Developer Platform to ship cohesive AI tooling.

You’ll help drive reliability, performance, and developer experiences while mentoring peers and shaping the roadmap for AI-native workflows and automation across Cloudflare’s global network.

Qualifications

• 5+ years of experience building and operating production systems, ideally in AI infrastructure.
• Strong fundamentals in networking, APIs, reliability and observability.
• Experience designing or scaling distributed systems where latency, throughput, availability, and correctness matter.
• Ability to work across the stack, from API design to backend services and performance-critical code.
• Strong developer tools taste in APIs, SDKs, dashboards, CLIs, docs, and internal platforms.

Responsibilities

• Build core AI Gateway systems that handle high-volume inference traffic across providers, models, and Cloudflare’s global network.
• Design and implement APIs, routing primitives, observability features, controls, and developer workflows.
• Work across product and infrastructure boundaries with Workers AI, Agents, and the Developer Platform to make Cloudflare’s AI platform feel like one coherent product.
• Turn ambiguous product and technical ideas into prototypes, design docs, shipped features, and measurable production improvements.
• Improve reliability, performance, cost efficiency, and debuggability for latency-sensitive AI workloads.
• Build the software — and the software that builds the software: agents, tests, harnesses, evaluation loops, tools, and internal context.
• Sweat the developer experience: error messages, SDKs, dashboards, docs, examples, and API details.
• Mentor other engineers through design review, code review, debugging, and technical leadership.
• Bring strong opinions, clear judgment, and a willingness to revise your view when data proves otherwise.

Skills

Systems engineering

APIs design

Distributed systems

Observability & reliability

Developer tooling & docs

Tools

Go

Rust

TypeScript

Job description

Cloudflare is seeking a Senior Systems Engineer to build AI Gateway at the edge, enabling high-volume model inference with reliable, observable infrastructure. You will prototype across the stack—from APIs to dashboards—and work with Workers AI, Agents, and the Developer Platform to ship cohesive AI tooling.

You’ll help drive reliability, performance, and developer experiences while mentoring peers and shaping the roadmap for AI-native workflows and automation across Cloudflare’s global network.