Senior AI Research Engineer: LLM Training & Inference Infra

Academic Key

Paris

On-site

EUR 120,000 - 180,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

RSUs
ESPP
Conference attendance

Job summary

Datadog is seeking a Senior AI Research Engineer to build and operate large-scale LLM training and inference infrastructure in Paris. You will partner with Research Scientists to run distributed GPU workloads, optimize throughput, and improve researcher productivity with scalable job submission and scheduling.

You’ll design execution environments, pursue performance dashboards, and collaborate with platform teams on cluster capacity and networking.

Qualifications

  • Experience design and operation of distributed ML training/inference systems.
  • Deep understanding of throughput, latency, and scalability in large clusters.
  • Proficiency in Python and at least one systems language (C++, Rust, or Go).

Responsibilities

  • Design and operate distributed training/inference infra for LLMs.
  • Scale training with data, tensor, pipeline, and expert parallelism.
  • Build inference systems and RL rollout tooling for experiments.

Skills

Distributed systems
ML infrastructure
Python
C++

Tools

Ray
Kubernetes
Slurm

Job description

Datadog is seeking a Senior AI Research Engineer to build and operate large-scale LLM training and inference infrastructure in Paris. You will partner with Research Scientists to run distributed GPU workloads, optimize throughput, and improve researcher productivity with scalable job submission and scheduling.

You’ll design execution environments, pursue performance dashboards, and collaborate with platform teams on cluster capacity and networking.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior LLM Infrastructure Engineer - Training & Inference
Senior LLM Infrastructure Engineer - Training & Inference

Datadog, Inc. • Paris

On-site
EUR 120,000 - 180,000
RSUs and ESPP
Conference attendance
Mentor program
+1
Senior AI Systems Engineer, Large-Scale Infra
Senior AI Systems Engineer, Large-Scale Infra

Datadog, Inc. • Paris

Hybrid
EUR 100,000 - 140,000
Stock options
Conference opportunities
Mentor program
+1
Senior AI GPU Kernel Engineer - LLM Training
Senior AI GPU Kernel Engineer - LLM Training

Academic Key • Paris

Hybrid
EUR 120,000 - 180,000
Hybrid work model
Senior AI Research Engineer - LLM Training & Inference Infrastructure
Senior AI Research Engineer - LLM Training & Inference Infrastructure

Academic Key • Paris

On-site
EUR 120,000 - 180,000
RSUs
ESPP
Conference attendance
Senior AI GPU Kernel Engineer — Hybrid, Paris
Senior AI GPU Kernel Engineer — Hybrid, Paris

Datadog, Inc. • Paris

Hybrid
EUR 90,000 - 130,000
AI Research Engineer - Distributed Training / LLMs
AI Research Engineer - Distributed Training / LLMs

European Tech Recruit • Paris

On-site
EUR 90,000 - 130,000
Senior AI Research Engineer — GPU Kernels & LLM Training
Senior AI Research Engineer — GPU Kernels & LLM Training

ContentBuffer • Paris

Hybrid
EUR 90,000 - 120,000
Senior LLM Inference Engineer — GPU‑Driven Serving
Senior LLM Inference Engineer — GPU‑Driven Serving

Doctolib • Levallois-Perret

Hybrid
EUR 110,000 - 150,000
Health insurance
Lunch vouchers
Remote work flexibility
+2
Senior AI Research Engineer - GPU Systems & Kernels
Senior AI Research Engineer - GPU Systems & Kernels

Academic Key • Paris

Hybrid
EUR 120,000 - 180,000
Hybrid work model
Senior GPU Kernel Engineer for AI Training & Inference
Senior GPU Kernel Engineer for AI Training & Inference

Datadog, Inc. • Paris

Hybrid
EUR 90,000 - 150,000