Senior AI Infrastructure Engineer - Rust & High-Scale Systems

Kraken International; United States; Remote; USD 180,000 - 280,000; Full time

Job summary

Kraken is seeking an experienced engineer to design and operate AI infrastructure powering agent systems in production. You will build high-performance Rust services for model inference, orchestration, and execution, supporting millions of users with low latency.

Join a high-scale, reliability-focused team, shaping ML infrastructure, MLOps patterns, and observability. A strong ownership mindset and collaboration across teams are essential for success.

Qualifications

• 5+ years of experience building and operating high-scale production systems.
• Strong proficiency in Rust and systems-level programming.
• Deep understanding of distributed systems, reliability engineering, and performance optimization.
• Experience operating services serving millions of users or high-throughput workloads.
• Familiarity with ML infrastructure, model serving, or MLOps in production environments.
• Experience designing observability, monitoring, and failure recovery systems.
• Strong collaboration across infrastructure and engineering teams.

Responsibilities

• Design and build the infrastructure layer powering AI agent systems in production.
• Develop high-performance Rust services that handle model inference, orchestration, and execution.
• Architect scalable systems capable of supporting millions of users and high request throughput.
• Build reliable ML infrastructure and MLOps patterns for model deployment, evaluation, and monitoring.
• Define guardrails, observability, and failure handling for agent-driven workflows.
• Optimize latency, throughput, and cost across inference and orchestration layers.
• Partner with the Agent Systems team to translate experiments into production systems.
• Contribute to foundational infrastructure decisions in a high-scale, high-impact environment.

Skills

Rust

Distributed systems

Reliability engineering

Performance optimization

ML infrastructure

Observability

Job description

Kraken is seeking an experienced engineer to design and operate AI infrastructure powering agent systems in production. You will build high-performance Rust services for model inference, orchestration, and execution, supporting millions of users with low latency.

Join a high-scale, reliability-focused team, shaping ML infrastructure, MLOps patterns, and observability. A strong ownership mindset and collaboration across teams are essential for success.