Senior AI Gateway Systems Engineer - Edge Infrastructure

FDE Times; Indiana; On-site; USD 185,000 - 266,000; Full time

Benefits offered by this job

Medical Insurance

401(k) Plan

Paid time off

Job summary

Cloudflare is seeking a Senior Systems Engineer to help build the AI Gateway layer. You will work across the stack from distributed systems and high-throughput APIs to developer-facing workflows, dashboards, SDKs, and docs, enabling AI applications on Cloudflare.

You should be excited by the pace of AI, with comfort using AI-native tools and building internal tools to accelerate engineering throughput while maintaining reliability and observability.

Qualifications

• 5+ years building and operating production systems, ideally in AI infrastructure or edge platforms.
• Strong systems engineering fundamentals: networking, reliability, observability, performance.
• Experience designing or scaling distributed systems with low latency and high throughput.

Responsibilities

• Build core AI Gateway systems that handle high-volume inference traffic.
• Design APIs, routing primitives, observability features, and developer workflows.
• Collaborate across product and infrastructure with Workers AI and the Developer Platform team.
• Turn ambiguous ideas into prototypes, shipped features, and measurable improvements.
• Improve reliability, performance, cost efficiency, and debuggability for latency-sensitive workloads.
• Develop agents, tests, harnesses, and internal tools to accelerate shipping.

Skills

Systems engineering

APIs

Observability

Distributed systems

Tools

Go

Rust

TypeScript

Job description

Cloudflare is seeking a Senior Systems Engineer to help build the AI Gateway layer. You will work across the stack from distributed systems and high-throughput APIs to developer-facing workflows, dashboards, SDKs, and docs, enabling AI applications on Cloudflare.

You should be excited by the pace of AI, with comfort using AI-native tools and building internal tools to accelerate engineering throughput while maintaining reliability and observability.