Staff SRE: AI Gateway Reliability & Platform Ops

Kraken; Comisión de Fomento de Perú; On-site; ARS 230,940,000 - 292,524,000; Full time

Job summary

Kraken is seeking a Senior Site Reliability Engineer to own the reliability of the AI Gateway, ensuring high availability and performance across production services. You will define SLOs, implement resilience strategies and collaborate with security and governance teams.

You will lead incident response, develop observability for model traffic, and scale infrastructure as workloads grow, mentoring engineers and elevating the Dev Platform standards.

Qualifications

• Extensive experience in site reliability, infrastructure or platform engineering.
• Deep hands-on experience with Kubernetes, major cloud provider and Terraform.
• Strong command of SLOs, observability and incident management.
• Proficiency in Rust or Python and production code familiarity.
• Experience with API gateways, reverse proxies or traffic management.
• Knowledge of Consul and Vault for service discovery and secrets management.
• Working knowledge of authentication/authorization mechanisms (OAuth 2.0/OIDC, JWT, mTLS).
• Experience with model evaluations and eval pipelines to compare models and catch quality regressions.
• Familiarity with agent harnesses and running them safely in sandboxed environments.

Responsibilities

• Own the reliability, availability and performance of the AI Gateway as a production-critical service used across the company.
• Design the gateway's resilience: multi-provider routing, failover, retries, rate limiting and graceful degradation.
• Set the technical direction for gateway architecture, capacity planning and scaling as traffic grows.
• Build observability for LLM traffic, covering latency, errors, token usage and cost.
• Partner with Security, Finance and AI governance to implement access controls and data handling requirements.
• Lead incident response and blameless post-incident reviews and drive reliability improvements.
• Automate operations through infrastructure as code and progressive rollouts.
• Mentor engineers and raise operating standards across Dev Platform.

Skills

Site reliability

Kubernetes

Terraform

Observability

Incident management

Rust/Python

APIs gateways

Consul/Vault

Auth protocols

Model eval pipelines

Agent memory

Staff leadership

Job description

Kraken is seeking a Senior Site Reliability Engineer to own the reliability of the AI Gateway, ensuring high availability and performance across production services. You will define SLOs, implement resilience strategies and collaborate with security and governance teams.

You will lead incident response, develop observability for model traffic, and scale infrastructure as workloads grow, mentoring engineers and elevating the Dev Platform standards.