Senior Platform Engineer – AI Gateway & LLM APIs

Kraken; Comisión de Fomento de Perú; On-site; ARS 277,128,000 - 369,504,000; Full time

Job summary

Kraken is building the AI Gateway within its Dev Platform, empowering engineers to access leading models with governance, observability, and cost reporting. The role focuses on designing scalable APIs and tooling, migrating workloads, and maintaining reliability across production systems.

You will own features end to end, collaborate with Security for access control, and contribute to engineering practices while improving the self-service experience for Kraken teams.

Qualifications

• Backend experience building APIs and distributed services in production.
• Proficiency in Rust, Python or TypeScript with well-tested, maintainable code.
• Understanding of LLM APIs, authentication, streaming responses and rate limits.
• Experience with observability, CI/CD and containers; comfort with Kubernetes and cloud providers.
• Ability to design clean, well-documented APIs for internal customers and to act with ownership.
• Clear written and verbal communication; able to carry work from idea to production.

Responsibilities

• Build and extend the AI Gateway: new model/provider integrations, routing policies, budgets, rate limits, and usage reporting.
• Design the APIs, SDKs and self-service tooling for onboarding Kraken engineers to the gateway.
• Help teams migrate LLM workloads onto the gateway with minimal disruption.
• Implement access control, key management and audit logging with Security.
• Instrument the gateway to show latency, errors, token usage and cost for workloads.
• Own features end to end, from design through production, with reliability alongside SRE.

Skills

Backend APIs

Rust/Python/TS

LLM APIs

Observability

Kubernetes

Documentation

Ownership

Tools

Docker

Kubernetes

Job description

Kraken is building the AI Gateway within its Dev Platform, empowering engineers to access leading models with governance, observability, and cost reporting. The role focuses on designing scalable APIs and tooling, migrating workloads, and maintaining reliability across production systems.

You will own features end to end, collaborate with Security for access control, and contribute to engineering practices while improving the self-service experience for Kraken teams.