SRE Lead, AI Gateway & Platform Reliability

Kraken

Colombia

On-site

COP 120,000,000 - 240,000,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Kraken is seeking a senior Dev Platform engineer to own the reliability of the AI Gateway, Kraken's LLM gateway, used across the company. You will drive resilience, capacity planning and scaling as traffic grows while building robust observability for LLM workloads.

You will collaborate with security, finance and governance teams to enforce access controls and audit logging, mentor engineers, and automate operations using infrastructure as code and progressive rollout strategies.

Qualifications

  • Extensive experience in site reliability, infrastructure or platform engineering with ownership of high-traffic services.
  • Proficiency with Kubernetes, cloud providers and infrastructure as code (Terraform).
  • Strong grasp of SLOs, observability, incident management and reliability engineering practices.
  • Proficiency in Rust or Python; comfortable reading production code.
  • Experience with API gateways, proxies, traffic management, load balancing, rate limiting and caching.
  • Familiarity with service discovery/secrets management (Consul, Vault).
  • Understanding of authentication/authorization mechanisms (OAuth 2.0/OIDC, JWT, mTLS, API keys) for multi-tenant platforms.
  • Experience with evaluating models or AI workloads and safety in production environments.

Responsibilities

  • Own the reliability, availability and performance of the AI Gateway as a production-critical service used across the company.
  • Design the gateway's resilience: multi-provider routing, failover, retries, rate limiting and graceful degradation.
  • Set the technical direction for gateway architecture, capacity planning and scaling as traffic grows.
  • Build observability for LLM traffic including latency, errors, token usage and cost by team/use case.
  • Collaborate with Security, Finance and AI governance to enforce access controls and audit logging.
  • Lead incident response and blameless post-incident reviews to drive improvements.
  • Automate operations via infrastructure as code, safe deployments and progressive rollouts.
  • Mentor engineers and raise the operating standard across the Dev Platform.

Skills

Kubernetes
Cloud infrastructure
SRE
Observability
Python or Rust
Security awareness

Tools

Terraform
Consul
Vault

Job description

Kraken is seeking a senior Dev Platform engineer to own the reliability of the AI Gateway, Kraken's LLM gateway, used across the company. You will drive resilience, capacity planning and scaling as traffic grows while building robust observability for LLM workloads.

You will collaborate with security, finance and governance teams to enforce access controls and audit logging, mentor engineers, and automate operations using infrastructure as code and progressive rollout strategies.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Backend Engineer, AI Platform & LLM Gateway
Senior Backend Engineer, AI Platform & LLM Gateway

Kraken • Colombia

On-site
COP 90,000,000 - 180,000,000
Staff Site Reliability Engineer - Dev Platform
Staff Site Reliability Engineer - Dev Platform

Kraken • Colombia

On-site
COP 120,000,000 - 240,000,000
Senior Rust Engineer — Build AI-Driven Fintech Backends
Senior Rust Engineer — Build AI-Driven Fintech Backends

Kraken • Colombia

Hybrid
COP 388,387,000 - 582,581,000
Rust Backend Engineer – AI-Driven Crypto Platforms
Rust Backend Engineer – AI-Driven Crypto Platforms

Kraken • Colombia

On-site
COP 396,183,000 - 627,290,000
Senior Rust Systems Engineer – Core Platform
Senior Rust Systems Engineer – Core Platform

Kraken • Colombia

On-site
COP 342,540,000 - 529,381,000
Chief of Exchange Platform & Infrastructure
Chief of Exchange Platform & Infrastructure

Kraken • Colombia

On-site
COP 467,101,000 - 685,081,000
Senior Analytics Engineer, Finance Data Platform & AI Automation
Senior Analytics Engineer, Finance Data Platform & AI Automation

Kraken • Colombia

On-site
COP 286,451,000 - 477,418,000
Senior Rust Engineer – Real-Time FinTech Infrastructure
Senior Rust Engineer – Real-Time FinTech Infrastructure

Kraken • Colombia

On-site
COP 120,000,000 - 180,000,000
Senior Software Engineer - Dev Platform
Senior Software Engineer - Dev Platform

Kraken • Colombia

On-site
COP 90,000,000 - 180,000,000
Staff Engineer - Verification Architect for Growth
Staff Engineer - Verification Architect for Growth

Kraken • Colombia

On-site
COP 462,792,000 - 586,203,000