Senior Backend Engineer, Gateway US - Remote · September 16, 2026

INFRO

Northern (KY)

Hybrid

USD 120,000 - 180,000

Full time

14 days+
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

INFRO is seeking a senior backend engineer to own large parts of the gateway path between customer applications and AI provider accounts. You will design and ship end-to-end gateway features in TypeScript running on Cloudflare Workers, backed by Postgres, focusing on speed, correctness under concurrency, and transparent measurement.

You will build provider adapters, ensure idempotency, retries, and robust error handling, write migrations and tests, participate in on-call rotations, and document

Qualifications

  • 5+ years building production backend services.
  • Experience with systems handling real traffic and billing data preferred.
  • Strong TypeScript, HTTP, SSE and JSON wire formats understanding.

Responsibilities

  • Design and ship gateway features end to end: request handling, provider adapters, streaming, and error taxonomy.
  • Add support for new provider kinds and wire formats without special-casing the router.
  • Keep hot path fast: avoid tokenizing per request, unbounded queries, and slow waits.
  • Write migrations and tests against a real Postgres, including concurrency edge cases.
  • Participate in an on-call rotation and document runbooks for shipped features.

Skills

TypeScript
HTTP
SSE
JSON wire formats
PostgreSQL
Distributed systems
Idempotency
Retries
Concurrency

Tools

Cloudflare Workers
Durable Objects
KV

Job description

The INFRO gateway sits between a customer's applications and the AI provider accounts they already hold. Every request is authenticated, checked against budgets and policy, routed to one of the customer's own provider connections, streamed back, and recorded with its latency, tokens and estimated provider cost.

You will own large parts of that path. It runs as TypeScript on Cloudflare Workers with Postgres behind it, and it has to stay fast, correct under concurrency, and honest about what it measured.

What you will do
  • Design and ship gateway features end to end: request handling, provider adapters, streaming, and the error taxonomy customers build against.
  • Add support for new provider kinds and wire formats (OpenAI-compatible, Anthropic Messages, Responses) without special-casing the router.
  • Keep the hot path cheap: no tokenizing per request, no unbounded queries, and nothing that waits on a mail server or a slow write.
  • Write migrations and tests against a real Postgres, including the concurrency cases a unit test cannot see.
  • Take part in an on-call rotation for the gateway and write the runbook entry for anything you ship.
What you will bring
  • 5+ years building production backend services, with at least one system that handled real traffic and real money or billing data.
  • Strong TypeScript, and comfort reading HTTP, SSE and JSON wire formats byte by byte.
  • Solid Postgres: schema design, migrations, indexes, transactions, and knowing when a query will scan a partition it should not.
  • Experience with idempotency, retries and race conditions in distributed systems.
  • Clear written communication. Most decisions here are made in writing.
Nice to have
  • Cloudflare Workers, Durable Objects, KV or Queues in production.
  • Hands-on work with LLM provider APIs (OpenAI, Anthropic, Bedrock, Vertex, Azure OpenAI).
  • Hono, Drizzle, or another edge-first TypeScript stack.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Backend Engineer — AI Gateway (TypeScript + Postgres)
Senior Backend Engineer — AI Gateway (TypeScript + Postgres)

INFRO • Northern (KY)

Hybrid
USD 120,000 - 180,000
Staff Engineer, Reliability & Routing US - Remote · September 4, 2026
Staff Engineer, Reliability & Routing US - Remote · September 4, 2026

INFRO • Northern (KY)

Hybrid
USD 140,000 - 190,000
Backend Engineer - AI Gateway Developer
Backend Engineer - AI Gateway Developer

P4N Solutions • Town of Texas (WI)

On-site
USD 150,000 - 210,000
Senior Software Engineer, R2 Gateway
Senior Software Engineer, R2 Gateway

Webhosting • Austin (TX), Northern (KY)

On-site
USD 150,000 - 230,000
Software Engineer
Software Engineer

Xcede • San Francisco (CA)

On-site
USD 150,000 - 190,000
Member of Technical Staff, Backend Engineer, API
Member of Technical Staff, Backend Engineer, API

Workman Labs • Northern (KY)

Hybrid
USD 240,000 - 290,000
Software Engineer, R2 Gateway
Software Engineer, R2 Gateway

Cloudflare • Austin (TX)

Hybrid
USD 140,000 - 190,000
Systems Engineer, R2 Gateway
Systems Engineer, R2 Gateway

Webhosting • Austin (TX), Northern (KY)

On-site
USD 180,000 - 240,000
Front End Software Engineer
Front End Software Engineer

Aria Networks, Inc. • Palo Alto (CA), Northern (KY)

Hybrid
USD 140,000 - 230,000
Senior GenAI Full-Stack Engineer - Brazil
Senior GenAI Full-Stack Engineer - Brazil

Bot Jobs • Myrtle Point (OR)

Remote
USD 60,000 - 108,000