Senior AI Gateway Systems Engineer

Cloudflare, Inc.; New York (NY); On-site; USD 185,000 - 254,000; Full time

Benefits offered by this job

Equity plan

Health & welfare benefits

401(k) retirement plan

Flexible paid time off

Job summary

Cloudflare, Inc. is seeking a Senior Systems Engineer to help build the AI Gateway layer at the network edge. You will work across the stack from distributed systems to developer-facing workflows, dashboards, SDKs, and docs, enabling AI applications to run fast and securely at Cloudflare’s scale.

You should enjoy turning half-formed ideas into production-ready systems, embracing AI-native tools, and collaborating across teams to ship reliably and iteratively.

Qualifications

• 5+ years building and operating production systems.
• Experience with AI infrastructure, developer platforms, or edge/proxy systems a plus.
• Strong fundamentals: networking, APIs, reliability, observability and performance.
• Ability to design or scale distributed systems with low latency, high throughput.

Responsibilities

• Build core AI Gateway systems that handle high-volume inference across providers and Cloudflare’s global network.
• Design and implement APIs, routing primitives, observability features, controls, and developer workflows.
• Collaborate across product and infra with Workers AI, Agents, and Developer Platform.
• Turn ambiguous ideas into prototypes, design docs, shipped features and measurable improvements.
• Improve reliability, performance, cost efficiency, and debuggability for latency-sensitive AI workloads.
• Develop tools and internal context to accelerate shipping.

Skills

TypeScript

Go

Rust

Distributed systems

APIs

Observability

Developer platforms

Tools

APIs

SDKs

CLIs

Dashboards

Job description

Cloudflare, Inc. is seeking a Senior Systems Engineer to help build the AI Gateway layer at the network edge. You will work across the stack from distributed systems to developer-facing workflows, dashboards, SDKs, and docs, enabling AI applications to run fast and securely at Cloudflare’s scale.

You should enjoy turning half-formed ideas into production-ready systems, embracing AI-native tools, and collaborating across teams to ship reliably and iteratively.