Senior Software Engineer – AI Infrastructure

Kraken; United States; Remote; USD 180,000 - 240,000; Full time

Job summary

Kraken is seeking a Senior Software Engineer for its AI Infrastructure team, focusing on building ML infrastructure and MLOps for high-scale systems. This role emphasizes reliability and scalability across distributed components within a fully remote environment.

You will collaborate with the Agent Systems team and other infrastructure partners to optimize latency and throughput for services serving millions of users, while shaping foundational infrastructure decisions for the platform.

Qualifications

• Strong Rust skills.
• Experience in distributed systems.

Responsibilities

• Build ML infrastructure and MLOps for high-scale systems.
• Ensure model inference and orchestration meet latency and reliability targets.
• Collaborate with Agent Systems and other infra teams to optimize performance.

Skills

Rust

Distributed systems

Job description

Kraken is seeking a Senior Software Engineer for its AI Infrastructure team, focusing on building ML infrastructure and MLOps for high-scale systems. Ideal candidates have strong Rust skills and experience in distributed systems.

The AI Infrastructure team at Kraken is responsible for developing and maintaining the production systems that support intelligent agents. This role emphasizes building reliable ML infrastructure, ensuring model inference and orchestration can handle real-world demands while maintaining performance and reliability standards.

Working in a fully remote environment, this position requires collaboration with the Agent Systems team and other infrastructure partners. Success in this role involves optimizing latency and throughput for services that cater to millions of users, while also contributing to foundational infrastructure decisions that impact the overall system's performance.