Staff SRE: AI Gateway Reliability Leader

Kraken Digital Asset Exchange

United States

Remote

USD 180,000 - 240,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Kraken Digital Asset Exchange, a leading crypto platform, is seeking a Senior Engineer to own the AI Gateway's reliability and performance. You will design resilient routing, implement rate limiting, and shape capacity planning as traffic grows.

You will build observability, partner with security and governance, and mentor other engineers to raise standards. You will work with Kubernetes, Terraform and cloud infra to deliver robust production systems, driving blameless post-incident reviews and

Qualifications

  • Extensive experience owning high-traffic services in production.
  • Deep knowledge of Kubernetes, Terraform and cloud infrastructure.
  • Strong reliability focus with clear incident response experience.
  • Ability to mentor engineers and drive architecture decisions.

Responsibilities

  • Own the reliability, availability and performance of the AI Gateway.
  • Design multi-provider routing, failover, retries and rate limiting.
  • Set technical direction for gateway architecture and capacity planning.
  • Build observability for latency, errors, token usage and cost.
  • Collaborate with Security, Finance and AI governance for controls.
  • Lead incident reviews and drive reliability improvements.
  • Automate operations with IaC, safe deployments and progressive rollouts.
  • Mentor engineers and raise operating standards across Dev Platform.

Skills

Site reliability
SLOs & incident management
Mentoring engineers
Reliability vs cost judgment
Programming in Rust or Python

Tools

Kubernetes
Terraform
Consul
Vault
OAuth 2.0 / OIDC / JWT / mTLS
API gateways / reverse proxies
Ray (distributed inference)
Vector stores / databases

Job description

Kraken Digital Asset Exchange, a leading crypto platform, is seeking a Senior Engineer to own the AI Gateway's reliability and performance. You will design resilient routing, implement rate limiting, and shape capacity planning as traffic grows.

You will build observability, partner with security and governance, and mentor other engineers to raise standards. You will work with Kubernetes, Terraform and cloud infra to deliver robust production systems, driving blameless post-incident reviews and

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff SRE – AI Gateway & Platform Reliability
Staff SRE – AI Gateway & Platform Reliability

Kraken • United States

Remote
USD 180,000 - 240,000
Senior Backend Engineer, AI Gateway Platform
Senior Backend Engineer, AI Gateway Platform

Kraken • United States

Remote
USD 56,000 - 97,000
Senior Backend Platform Engineer – AI Gateway & LLM Infra
Senior Backend Platform Engineer – AI Gateway & LLM Infra

Kraken Digital Asset Exchange • United States

Remote
USD 150,000 - 210,000
Senior SRE Manager, Managed Gateways - Reliability & Growth
Senior SRE Manager, Managed Gateways - Reliability & Growth

Kong Inc. • United States

Remote
USD 180,000 - 260,000
Senior AI Platform Engineer - LLM Gateway & Governance
Senior AI Platform Engineer - LLM Gateway & Governance

kraken.com • United States

Remote
USD 120,000 - 200,000
Senior AI Gateway Systems Engineer — Remote
Senior AI Gateway Systems Engineer — Remote

Partner Company • United States

Remote
USD 140,000 - 200,000
Health insurance
401(k) retirement plan
Paid time off
+3
Remote Data Platform Engineering Manager - Real-Time AI
Remote Data Platform Engineering Manager - Real-Time AI

Kraken • United States

Remote
USD 140,000 - 200,000
Staff Engineer, Reliability & Stability for AI Gateway
Staff Engineer, Reliability & Stability for AI Gateway

LiteLLM • San Francisco (CA)

On-site
USD 180,000 - 260,000
Relocation assistance
Competitive compensation
Health, dental, and vision benefits
+1
Senior Software Engineer – AI Infrastructure
Senior Software Engineer – AI Infrastructure

Kraken • United States

Remote
USD 180,000 - 240,000
Staff SRE — Remote AI-Driven Blockchain Infra
Staff SRE — Remote AI-Driven Blockchain Infra

Circle • United States

Remote
USD 195,000 - 258,000