Research Engineer, GPU Performance

Mistral.ai; Paris; On-site; EUR 110,000 - 160,000; Full time

Benefits offered by this job

Healthcare coverage

Parental leave

Relocation support

Wellness programs

Meal and transportation allowances

Job summary

Mistral AI is seeking a Research Engineer, GPU performance, to work at the core of our frontier AI models. You will write low-level code to extract maximum GPU throughput, collaborating with Research Scientists to push architectures toward efficient inference and scalable training.

You’ll integrate improvements into our MLOps framework, profile on thousands of GPUs, and help shape how hardware resources are measured and served for large language models.

Qualifications

• Experience writing custom low-level kernels for GPUs.
• Familiarity with distributed GPU clusters and high-performance computing.
• Strong knowledge of generative AI models and fine-tuning.
• Software design basics: testing, code review, CI/CD.
• Self-motivated, collaborative attitude.

Responsibilities

• Develop low-level code to maximize GPU capacity, from custom kernels to memory layout and communication optimisations.
• Rethink model architectures for efficient inference with Research Scientists.
• Integrate low-level optimisations into a high-level MLOps framework for broad impact.
• Profile, benchmark, and optimize performance across thousands of GPUs during training and inference.
• Assess hardware usage and build serving performance estimates for LLM execution.

Skills

Low-level GPU kernels

Distributed GPU clusters

Generative AI understanding

CI/CD and testing

Self-starter

Job description

About Mistral

Mistral provides full-stack AI solutions: from frontier models to developer tools, applications, and compute. We partner with enterprises tackling the hardest problems across high-stakes industries like finance, manufacturing, defense, healthcare, and the public sector, co-creating customized AI systems that they can run on their terms.

We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between Europe, North America, Asia and the Middle East. We are creative, low-ego and team-spirited.

About the Role

As a Research Engineer, GPU performance, you will sit at the heart of that spectrum: your low-level work directly determines how fast our frontier models can be trained and served. Working hand-in-hand with Research Scientists, you'll make every GPU count.

Mistral AI is hiring an expert in pushing large language model's GPU utilization and performance to their limits.. In this role, you will own the performance of our models end-to-end: writing the low-level code that extracts the maximum capacity from high-end hardware, and rethinking model architectures so they run efficiently at scale.

What You Will Do

• Develop low-level code that takes full advantage of high-end GPUs and maxes out their capacity — from custom kernels to memory-layout and communication optimisations.

• Rethink parts of the generative model architecture to make them more suitable for efficient inference, in collaboration with Research Scientists.

• Integrate low-level efficient code into a high-level MLOps framework, so that optimisations benefit every training run and deployment rather than a single experiment.

• Profile, benchmark and squeeze performance out of large-scale training and inference on thousands of GPUs.

• Model LLM execution on various GPUs with high fidelity to assess hardware usage and build serving performance estimates.

What We’re Looking For

• High technical competence for writing custom low-level kernels and pushing GPUs to their limits.

• High expertise in the distributed computation infrastructure of current-generation GPU clusters.

• Overall understanding of the field of generative AI; knowledge of, or interest in, fine-tuning and using language models for applications.

• Strong software-design instincts: testing, code review, CI/CD.

• Self-starter, low-ego, collaborative.

What We Offer

We offer a comprehensive benefits package designed to support your well-being, growth, and work-life balance. Benefits vary by country and may include healthcare coverage, parental leave, retirement plans, relocation support, wellness programs, meal and transportation allowances, and other location-specific perks.

For the most up-to-date details on benefits available in your location, please refer to our Benefits page.

Privacy Policy

Your privacy matters to us. You can learn more about how we handle your personal data in our Applicant Privacy Policy.