Senior Backend Engineer, AI Platform & LLM Gateway

Kraken

Colombia

On-site

COP 90,000,000 - 180,000,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Kraken is seeking a Backend/Platform engineer to join the Dev Platform team and help build the AI Gateway that connects models from major providers. You will design APIs, SDKs, and self-service tooling for Kraken engineers to onboard quickly and safely.

You will migrate workloads with minimal disruption, implement security controls, and instrument metrics for cost and performance. Collaborate with SRE to keep the gateway reliable and scalable.

Qualifications

  • Experience building and operating APIs and distributed services in production.
  • Proficiency in Rust, Python or TypeScript with well-tested, maintainable code.
  • Understanding of LLM APIs, authentication, streaming, token accounting and rate limits.
  • Experience with observability, CI/CD and containers; comfortable with Kubernetes and cloud providers.
  • Ability to design clean, well-documented internal APIs and act on feedback.
  • Strong written and verbal communication with ownership from idea to production.

Responsibilities

  • Build and extend the AI Gateway with new model/provider integrations and reporting.
  • Design APIs, SDKs, and self-service tooling for fast, safe internal onboarding.
  • Help migrate LLM workloads to the gateway with minimal disruption.
  • Implement access control, key management, and audit logging with Security.
  • Instrument latency, errors, token usage, and cost for internal workloads.
  • Own features end to end and collaborate with SRE to keep services reliable.
  • Provide documentation and debugging support; incorporate feedback into roadmaps.
  • Contribute to code reviews, design docs, and engineering practices.

Skills

Backend/API design
Rust/Python/TypeScript
LLM API familiarity
Observability/CI/CD/Containers
Kubernetes / Cloud
Clear communication

Tools

Kubernetes

Job description

Kraken is seeking a Backend/Platform engineer to join the Dev Platform team and help build the AI Gateway that connects models from major providers. You will design APIs, SDKs, and self-service tooling for Kraken engineers to onboard quickly and safely.

You will migrate workloads with minimal disruption, implement security controls, and instrument metrics for cost and performance. Collaborate with SRE to keep the gateway reliable and scalable.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

SRE Lead, AI Gateway & Platform Reliability
SRE Lead, AI Gateway & Platform Reliability

Kraken • Colombia

On-site
COP 120,000,000 - 240,000,000
Rust Backend Engineer – AI-Driven Crypto Platforms
Rust Backend Engineer – AI-Driven Crypto Platforms

Kraken • Colombia

On-site
COP 396,183,000 - 627,290,000
Senior Rust Engineer — Build AI-Driven Fintech Backends
Senior Rust Engineer — Build AI-Driven Fintech Backends

Kraken • Colombia

Hybrid
COP 388,387,000 - 582,581,000
Senior Software Engineer - Dev Platform
Senior Software Engineer - Dev Platform

Kraken • Colombia

On-site
COP 90,000,000 - 180,000,000
Senior Analytics Engineer, Finance Data Platform & AI Automation
Senior Analytics Engineer, Finance Data Platform & AI Automation

Kraken • Colombia

On-site
COP 286,451,000 - 477,418,000
Staff Site Reliability Engineer - Dev Platform
Staff Site Reliability Engineer - Dev Platform

Kraken • Colombia

On-site
COP 120,000,000 - 240,000,000
Software Engineer II - High-Performance Trading Backends
Software Engineer II - High-Performance Trading Backends

Kraken • Colombia

On-site
COP 382,226,000 - 573,340,000
Chief of Exchange Platform & Infrastructure
Chief of Exchange Platform & Infrastructure

Kraken • Colombia

On-site
COP 467,101,000 - 685,081,000
Senior Software Engineer, AI Agent Systems (Remote)
Senior Software Engineer, AI Agent Systems (Remote)

Trammell Venture Partners, L.L.C. • Colombia

Remote
COP 382,226,000 - 573,340,000
Senior Rust Engineer for High-Performance Trading Backend
Senior Rust Engineer for High-Performance Trading Backend

Kraken • Colombia

On-site
COP 180,000,000 - 280,000,000