Remote Full-Stack Engineer - AI Gateway & Scale

Ngrok; San Francisco (CA); Hybrid; USD 203,000 - 248,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Open, flexible vacation policy

Parental leave

Home office/desk stipend

Lunch in SF office

Company offsites

Job summary

ngrok is seeking a Senior Software Engineer to help build the AI Gateway and enforce traffic policies. You will measure AI usage, ensure observable behavior, and design safe abstractions with product and design teams. Remote-friendly with hybrid options near SF.

Ideal candidates have Go/Rust/C++/Java experience, frontend TS/React, and familiarity with AI/LLMs. Strong focus on performance, reliability, and cost controls is essential.

Qualifications

• Experience with statically typed languages (Go, Rust, C++, Java) is preferred.
• Frontend experience with TypeScript, React, HTML, CSS.
• Familiarity with AI/LLMs and edge-case awareness.
• Strong focus on developer experience and safe abstractions.
• Interest in retries, limits, and cost considerations.

Responsibilities

• Build and evolve the AI Gateway: classify and handle AI traffic in real time.
• Own AI traffic policy enforcement: design and implement policies.
• Track AI usage and token consumption across requests.
• Make AI behavior observable and explainable with signals.
• Design abstractions that hide complexity for customers.
• Ship systems in production with cross-team collaboration.

Skills

Go

Rust

C++

Java

TypeScript

React

HTML

CSS

AI/LLMs

Tools

AWS

Kubernetes

PostgreSQL

Kafka

Protobuf

Go

TypeScript

React

Job description

ngrok is seeking a Senior Software Engineer to help build the AI Gateway and enforce traffic policies. You will measure AI usage, ensure observable behavior, and design safe abstractions with product and design teams. Remote-friendly with hybrid options near SF.

Ideal candidates have Go/Rust/C++/Java experience, frontend TS/React, and familiarity with AI/LLMs. Strong focus on performance, reliability, and cost controls is essential.