Research Engineer, ML Platform

Mistral AI

United States

Remote

USD 180,000 - 230,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Healthcare coverage
Parental leave
Retirement plans
Relocation support
Wellness programs
Meal and transportation allowances

Job summary

Mistral AI is seeking an experienced ML Platform Engineer to design and operate the infrastructure powering large-scale training, evaluation, and batch inference. You will enable researchers and engineers to run distributed GPU workloads reliably across clusters and regions while building self-service tooling and robust APIs.

You will own critical systems, improve performance and reliability, and collaborate across a fast-moving frontier AI environment.

Qualifications

  • Experience building ML infrastructure and distributed systems.
  • Proficiency in Python or Go and production-grade distributed systems.
  • Strong Kubernetes knowledge: controllers, operators, CRDs, scheduling, networking, storage, resources.
  • Familiarity with Kueue, Karpenter, Volcano, Kyverno and workload scheduling.
  • Experience with GPU infrastructure and tools like PyTorch, CUDA, NCCL.
  • Understanding of quotas, priorities, preemption, gang scheduling, topology awareness.

Responsibilities

  • Build the ML Platform with services, APIs, controllers, and tooling for training, evaluation, and batch inference.
  • Orchestrate GPU workloads with queueing, admission control, quotas, priorities, and topology-aware placement.
  • Manage compute capacity across clusters and heterogeneous GPU resources.
  • Enable multi-cluster execution based on capacity, data locality, and hardware requirements.
  • Improve researcher experience with self-service workflows for distributed workloads.
  • Optimize performance: GPU utilization, scheduling latency, startup time, throughput.
  • Build for reliability with observability, failure recovery, and capacity planning.
  • Operate and troubleshoot applications, schedulers, networking, storage, and GPU infrastructure during on-call rotations.

Skills

ML infrastructure
Distributed systems
Kubernetes
Python
Go
GPU/CUDA
Observability
On-call

Tools

Kueue
Karpenter
Volcano
Kyverno

Job description

About Mistral

Mistral provides full-stack AI solutions: from frontier models to developer tools, applications, and compute. We partner with enterprises tackling the hardest problems across high-stakes industries like finance, manufacturing, defense, healthcare, and the public sector, co-creating customized AI systems that they can run on their terms. We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between Europe, North America, Asia and the Middle East. We are creative, low-ego and team-spirited.

The Role

This role focuses on building and operating the ML platform that powers large-scale training, evaluation, and batch inference at Mistral AI. You will develop the infrastructure that enables researchers and engineers to run distributed GPU workloads reliably across clusters, hardware types, and regions. You will work across the full ML lifecycle, from workload scheduling and capacity management to platform APIs, observability, and production operations. You will take ownership of critical systems and help turn complex infrastructure into reliable, self-service capabilities.

What You Will Do
  • Build the ML Platform: Develop services, APIs, controllers, and tooling for training, evaluation, fine-tuning, and batch inference.
  • Orchestrate GPU Workloads: Build systems for queueing, admission control, quotas, priorities, preemption, and topology-aware placement.
  • Manage Compute Capacity: Improve how heterogeneous GPU resources are provisioned, allocated, and utilized across clusters.
  • Enable Multi-Cluster Execution: Place workloads based on capacity, data locality, hardware requirements, and organizational priorities.
  • Improve Researcher Experience: Create self-service workflows that make distributed workloads easy to launch, observe, debug, and reproduce.
  • Optimize Performance: Improve GPU utilization, scheduling latency, workload startup time, throughput, and infrastructure efficiency.
  • Build for Reliability: Develop observability, failure recovery, capacity planning, and operational tooling for critical ML workloads.
  • Operate What You Build: Participate in on-call rotations and troubleshoot issues across applications, schedulers, networking, storage, and GPU infrastructure.
What We're Looking For
  • Have 4+ years of experience in ML infrastructure, distributed systems, Kubernetes platform engineering, or a related field.
  • Are proficient in Python or Go and comfortable working with production-grade distributed systems.
  • Have strong Kubernetes knowledge, including controllers, operators, CRDs, scheduling, networking, storage, and resource management.
  • Understand technologies such as Kueue, Karpenter, Volcano, and Kyverno, and the problems they address in workload scheduling, provisioning, and policy enforcement.
  • Understand distributed ML workloads, including training, fine-tuning, evaluation, checkpointing, and batch inference.
  • Are familiar with GPU infrastructure and technologies such as PyTorch, CUDA, NCCL, and high-performance networking.
  • Understand concepts such as quotas, priorities, preemption, gang scheduling, topology awareness, and workload admission.
  • Can diagnose performance and reliability problems across software, orchestration, networking, storage, and hardware.
  • Care about developer experience and enjoy turning complex infrastructure into simple, reliable interfaces.
  • Thrive in an ambiguous, fast-moving environment shaped by frontier AI research.
What We Offer

We offer a comprehensive benefits package designed to support your well-being, growth, and work-life balance. Benefits vary by country and may include healthcare coverage, parental leave, retirement plans, relocation support, wellness programs, meal and transportation allowances, and other location-specific perks.

  • Benefits vary by country and may include healthcare coverage, parental leave, retirement plans, relocation support, wellness programs, meal and transportation allowances, and other location-specific perks.

For the most up-to-date details on benefits available in your location, please refer to our Benefits page .

Privacy Policy

Your privacy matters to us. You can learn more about how we handle your personal data in our Applicant Privacy Policy .

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Research Engineer, ML Platform
Research Engineer, ML Platform

Precision Labs • Palo Alto (CA)

Hybrid
USD 170,000 - 230,000
Healthcare coverage
Retirement plans
Relocation support
+2
Research Engineer, ML Platform
Research Engineer, ML Platform

Mistral AI • Iowa

On-site
USD 180,000 - 230,000
Site Reliability Engineer, Fleet Health & Delivery
Site Reliability Engineer, Fleet Health & Delivery

Mistral AI • United States

On-site
USD 140,000 - 210,000
Healthcare coverage
Parental leave
Retirement plans
+4
Site Reliability Engineer, Fleet Health & Delivery
Site Reliability Engineer, Fleet Health & Delivery

Mistral AI • New York (NY)

Remote
USD 130,000 - 180,000
Research Engineer, Machine Learning
Research Engineer, Machine Learning

Mistral AI • Paris (TX)

On-site
USD 140,000 - 200,000
Healthcare coverage
Parental leave
Retirement plans
+3
Research Engineer, Code Agents Infra
Research Engineer, Code Agents Infra

Mistral AI • United States

Remote
USD 180,000 - 320,000
Healthcare coverage
Relocation support
Retirement plans
+1
VP, Production Platform
VP, Production Platform

Mistral AI • Paris (TX)

On-site
USD 260,000 - 380,000
AI Scientist
AI Scientist

Mistral AI • United States

On-site
USD 140,000 - 210,000
Healthcare coverage
Relocation support
Retirement plans
Developer Relations Engineer
Developer Relations Engineer

Mistral • Palo Alto (CA)

On-site
USD 120,000 - 170,000
Healthcare coverage
Parental leave
Retirement plans
+4
Site Reliability Engineer, Mistral Cloud
Site Reliability Engineer, Mistral Cloud

Mistral • New York (NY)

On-site
USD 120,000 - 180,000
Healthcare coverage
Parental leave
Retirement plans
+2