GPU Performance Research Engineer — Scale LLMs (Relocation)

Mistral; Paris; Hybrid; EUR 90,000 - 140,000; Full time

Benefits offered by this job

Healthcare coverage

Parental leave

Retirement plans

Relocation support

Wellness programs

Meal and transportation allowances

Job summary

Mistral is hiring a Research Engineer, GPU performance to optimize frontier models on high-end hardware. You will write low-level kernels and optimise memory layouts and communications, collaborating closely with Research Scientists to maximize GPU utilization.

You will also rethink model architectures for efficient inference and integrate improvements into a scalable MLOps framework to benefit training and deployment across clusters.

Qualifications

• Low-level kernels development and GPU optimization.
• Distributed GPU clusters infrastructure expertise.
• Understanding of generative AI and model fine-tuning/apps.

Responsibilities

• Develop low-level code that utilizes high-end GPUs to max capacity.
• Rethink model architectures for efficient inference with researchers.
• Integrate low-level code into a high-level MLOps framework for scalable runs.

Skills

Low-level kernels

Distributed GPU clusters

Generative AI knowledge

Software design CI/CD

Self-starter collaborative

Job description

Mistral is hiring a Research Engineer, GPU performance to optimize frontier models on high-end hardware. You will write low-level kernels and optimise memory layouts and communications, collaborating closely with Research Scientists to maximize GPU utilization.

You will also rethink model architectures for efficient inference and integrate improvements into a scalable MLOps framework to benefit training and deployment across clusters.