Senior AI Platform Engineer – Backend & Gateway

Blockwisely; United States; Remote; USD 150,000 - 190,000; Full time

Job summary

Payward’s Kraken Dev Platform team builds the internal platform used by Kraken engineers to ship and run software. The AI Gateway provides access to models from Anthropic, OpenAI and Google, with governance, budgets, rate limits, and cost visibility.

As a backend/platform engineer, you will implement model/provider integrations, design APIs/SDKs, ensure reliability with SRE, and help teams migrate workloads with minimal disruption, while improving observability and security.

Qualifications

• Experience building and operating APIs and distributed services in production.
• Proficient in a backend language (Rust, Python or TypeScript).
• Knowledge of LLM API behavior: auth, streaming, tokens, rate limits.
• Familiar with Kubernetes and cloud providers.
• Ability to design clean APIs for internal teams.

Responsibilities

• Build and extend the AI Gateway: model/provider integrations, routing, budgets, cost reporting.
• Design APIs, SDKs and self-service tooling for engineers to onboard safely.
• Help teams migrate LLM workloads with minimal disruption.
• Implement access control, key management and audit logging.
• Instrument gateway to monitor latency, errors, token usage and cost.
• Own features end-to-end from design to production with SRE reliability.
• Support internal users with documentation and feedback shaping roadmap.
• Contribute to code reviews, design docs and engineering practices.

Skills

Backend API design

Distributed systems

Observability & CI/CD

Security & access control

Documentation & collaboration

Tools

Rust

Python

TypeScript

Kubernetes

Major cloud provider

Job description

Payward’s Kraken Dev Platform team builds the internal platform used by Kraken engineers to ship and run software. The AI Gateway provides access to models from Anthropic, OpenAI and Google, with governance, budgets, rate limits, and cost visibility.

As a backend/platform engineer, you will implement model/provider integrations, design APIs/SDKs, ensure reliability with SRE, and help teams migrate workloads with minimal disruption, while improving observability and security.