Senior Backend Platform Engineer – AI Gateway & LLM Infra

Kraken Digital Asset Exchange

United States

Remote

USD 150,000 - 210,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Kraken is seeking a backend/platform software engineer to build and operate APIs and distributed services for the AI Gateway. You will design clean APIs, extend integrations with models and providers, and help migrate workloads with minimal downtime.

Strong experience in Rust, Python or TypeScript and solid knowledge of Kubernetes and cloud tooling are essential. You will own features end-to-end, work closely with Security and SRE teams, and provide clear documentation and internal support.

Qualifications

  • Experience building and operating APIs and distributed services in production.
  • Strong backend language skills (Rust, Python or TypeScript).
  • Familiar with LLM API behavior: authentication, streaming, token accounting, rate limits.

Responsibilities

  • Build and extend the AI Gateway, including model/provider integrations and usage reporting.
  • Design APIs, SDKs, and self-service tooling for Kraken engineers.
  • Migrate LLM workloads with minimal disruption and ensure reliability with SRE practices.
  • Implement access control, key management, and audit logging in collaboration with Security.
  • Instrument gateway metrics for latency, errors, token usage, and cost.

Skills

Backend development
Distributed systems
Rust
Python
TypeScript
APIs

Tools

Kubernetes
Cloud providers
CI/CD

Job description

Kraken is seeking a backend/platform software engineer to build and operate APIs and distributed services for the AI Gateway. You will design clean APIs, extend integrations with models and providers, and help migrate workloads with minimal downtime.

Strong experience in Rust, Python or TypeScript and solid knowledge of Kubernetes and cloud tooling are essential. You will own features end-to-end, work closely with Security and SRE teams, and provide clear documentation and internal support.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Backend Engineer, AI Gateway Platform
Senior Backend Engineer, AI Gateway Platform

Kraken • United States

Remote
USD 56,000 - 97,000
Senior AI Platform Engineer - LLM Gateway & Governance
Senior AI Platform Engineer - LLM Gateway & Governance

kraken.com • United States

Remote
USD 120,000 - 200,000
Senior Software Engineer – AI Infrastructure
Senior Software Engineer – AI Infrastructure

Kraken • United States

Remote
USD 180,000 - 240,000
Senior AI Infrastructure Engineer - Rust & High-Scale Systems
Senior AI Infrastructure Engineer - Rust & High-Scale Systems

Kraken International • United States

Remote
USD 180,000 - 280,000
Staff SRE – AI Gateway & Platform Reliability
Staff SRE – AI Gateway & Platform Reliability

Kraken • United States

Remote
USD 180,000 - 240,000
Senior Rust Backend Engineer: AI-Driven, End-to-End Ownership
Senior Rust Backend Engineer: AI-Driven, End-to-End Ownership

kraken.com • United States

Remote
USD 180,000 - 260,000
Staff SRE: AI Gateway Reliability Leader
Staff SRE: AI Gateway Reliability Leader

Kraken Digital Asset Exchange • United States

Remote
USD 180,000 - 240,000
Remote Senior AI Infra Engineer (Rust, MLOps)
Remote Senior AI Infra Engineer (Rust, MLOps)

Kraken • United States

Remote
USD 180,000 - 240,000
Platform Backend Engineer (Rust, AI Infra)
Platform Backend Engineer (Rust, AI Infra)

Archetype AI Inc. • San Mateo (CA)

On-site
USD 150,000 - 210,000
Senior Software Engineer - Dev Platform
Senior Software Engineer - Dev Platform

kraken.com • United States

Remote
USD 120,000 - 200,000