Senior AI Infrastructure Engineer — Rust, High-Scale ML

Kraken; Greater London; On-site; GBP 90,000 - 140,000; Full time

Job summary

Kraken’s AI Infrastructure team builds production systems powering intelligent agents at scale, focusing on model inference, orchestration, and execution. The role demands Rust expertise and strong systems thinking to deliver reliable, high-performance services across millions of users.

Joining the team means shaping foundational infra in a high-stakes environment, with emphasis on observability, latency optimization, and cross-functional collaboration with infrastructure and applied engineering

Qualifications

• 5+ years of experience building and operating high-scale production systems.
• Strong proficiency in Rust and systems-level programming.
• Deep understanding of distributed systems, reliability engineering, and performance optimization.
• Experience operating services serving millions of users or high-throughput workloads.
• Familiarity with ML infrastructure, model serving, or MLOps in production environments.
• Experience designing observability, monitoring, and failure recovery systems.

Responsibilities

• Design and build the infrastructure layer powering AI agent systems in production.
• Develop high-performance Rust services that handle model inference, orchestration, and execution.
• Architect scalable systems capable of supporting millions of users and high request throughput.
• Build reliable ML infrastructure and MLOps patterns for model deployment, evaluation, and monitoring.
• Define guardrails, observability, and failure handling for agent-driven workflows.
• Optimize latency, throughput, and cost across inference and orchestration layers.
• Partner with the Agent Systems team to translate prototypes into production systems.
• Contribute to foundational infrastructure decisions in a high-scale environment.

Skills

Rust

Distributed systems

Reliability engineering

Performance optimization

Observability

High-scale production

Tools

Container orchestration

Cloud-native infrastructure

Model serving / MLOps

Job description

Kraken’s AI Infrastructure team builds production systems powering intelligent agents at scale, focusing on model inference, orchestration, and execution. The role demands Rust expertise and strong systems thinking to deliver reliable, high-performance services across millions of users.

Joining the team means shaping foundational infra in a high-stakes environment, with emphasis on observability, latency optimization, and cross-functional collaboration with infrastructure and applied engineering