Senior Full-Stack Engineer — AI Gateway (Hybrid SF)

ngrokinc; United States; Hybrid; USD 180,000 - 230,000; Full time

Benefits offered by this job

Hybrid schedule two in-office days per

Premium health coverage

401(k) with employer match

Flexible vacation policy

Parental leave (16 weeks birthing, 8+)

Professional development budget

Home office stipend

Co-working space stipend

Catered lunches when onsite

Performance reviews with benchmarking

Salary and equity bands by location

Job summary

ngrok is seeking a senior full-stack engineer to own the AI-aware layer of a production gateway. You will design and operate request-path systems that classify, govern, and measure AI traffic with a focus on latency, safety, and observable behavior on the hot path.

You will collaborate across gateway, data, and platform teams, implement policy objects for AI workloads, and surface telemetry for support and billing. This hybrid role requires SF in-office presence two days per week.

Qualifications

• Several years of professional software engineering experience with ownership of systems that run in production.
• Strong proficiency in statically typed, compiled languages (Go, Rust, C++, Java).
• Frontend experience with TypeScript, React, HTML, and CSS.
• Practical exposure to AI or large language model workloads and related edge cases.

Responsibilities

• Design, build, and evolve gateway components that classify and handle AI traffic in real time, with emphasis on latency, safety, and predictable behavior on the hot path.
• Implement and own traffic policy objects tailored to AI workloads, including rate limits and access rules.
• Build and maintain metering systems that count requests, tokens, and metadata for customers to understand usage.
• Surface signals about what was allowed, blocked, or rate-limited to support telemetry-driven questions.
• Collaborate with gateway, data, and platform teams to keep policy enforcement, usage telemetry, and downstream billing signals consistent end to end.
• Partner with product and design to define AI-specific gateway primitives that feel intentional to operators.

Skills

Production ownership

Observability

Latency optimization

Tools

Go

Rust

C++

Java

TypeScript

React

HTML

CSS

Job description

ngrok is seeking a senior full-stack engineer to own the AI-aware layer of a production gateway. You will design and operate request-path systems that classify, govern, and measure AI traffic with a focus on latency, safety, and observable behavior on the hot path.

You will collaborate across gateway, data, and platform teams, implement policy objects for AI workloads, and surface telemetry for support and billing. This hybrid role requires SF in-office presence two days per week.