Senior Backend Engineer, AI Gateway Platform

Kraken; United States; Remote; USD 56,000 - 97,000; Full time

Job summary

Kraken is building the AI Gateway under Payward's umbrella, expanding model integrations and routing policies. You will design APIs and tooling to onboard Kraken engineers quickly and safely, while preserving security and performance.

You will own features end to end, from design to production, collaborating with Security, SREs and internal users to ensure reliable service and clear documentation.

Qualifications

• Experience building and operating production APIs and distributed services.
• Proficiency in Rust, Python or TypeScript with well-tested, maintainable code.
• Understanding of LLM APIs: authentication, streaming responses, token accounting, rate limits.

Responsibilities

• Build and extend Kraken's AI Gateway: model/provider integrations, routing, budgets, rate limits.
• Design APIs, SDKs, and self-service tooling for Kraken engineers.
• Migrate LLM workloads onto the gateway with minimal disruption.
• Implement access control and audit logging with Security.
• Instrument the gateway to expose latency, errors, token usage and cost.

Skills

Backend APIs

Rust

Python

TypeScript

Tools

Kubernetes

CI/CD

Cloud provider

Job description

Kraken is building the AI Gateway under Payward's umbrella, expanding model integrations and routing policies. You will design APIs and tooling to onboard Kraken engineers quickly and safely, while preserving security and performance.

You will own features end to end, from design to production, collaborating with Security, SREs and internal users to ensure reliable service and clear documentation.