Senior AI Systems Engineer, Large-Scale Infra

Datadog, Inc.

Paris

Hybrid

EUR 100,000 - 140,000

Full time

7 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Stock options
Conference opportunities
Mentor program
Global teams

Job summary

Datadog is seeking a Research Engineer on the Frontier Foundations team to partner with Research Scientists and build systems that enable large-scale LLM training, reinforcement learning, and inference.

You will design and operate distributed training and inference infrastructure for cutting-edge AI workloads, optimize throughput, and improve researcher productivity with job submission, scheduling, and GPU utilization. This role supports Datadog’s Paris and New York teams in a hybrid environment.

Qualifications

  • Depth in distributed systems and ML infrastructure for training and inference at scale.
  • Proficient in Python and in at least one systems language (e.g., Rust, C++, or Go).
  • Experience operating large-scale training or serving infrastructure, or schedulers and orchestration systems for GPU workloads.
  • Understand throughput/latency limits in distributed inference: communication, memory, scheduling, stragglers.
  • Strong debugging, profiling, and incident-diagnosis skills, on-call experience preferred.

Responsibilities

  • Design, build, and operate distributed training and inference infrastructure for LLMs, including Mixture-of-Experts models.
  • Scale training with parallelism strategies and memory optimization; checkpointing and failure recovery.
  • Build inference and rollout systems for evaluation, experimentation, and RL without slowing training.
  • Develop sandboxed environments for online RL and post-training evaluation.
  • Own continuous performance validation with dashboards showing regressions and throughput.

Skills

Distributed systems
ML infrastructure
Python
C++
Go
Rust

Tools

Ray
Kubernetes
Slurm

Job description

Datadog is seeking a Research Engineer on the Frontier Foundations team to partner with Research Scientists and build systems that enable large-scale LLM training, reinforcement learning, and inference.

You will design and operate distributed training and inference infrastructure for cutting-edge AI workloads, optimize throughput, and improve researcher productivity with job submission, scheduling, and GPU utilization. This role supports Datadog’s Paris and New York teams in a hybrid environment.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior LLM Infrastructure Engineer - Training & Inference
Senior LLM Infrastructure Engineer - Training & Inference

Datadog, Inc. • Paris

On-site
EUR 120,000 - 180,000
RSUs and ESPP
Conference attendance
Mentor program
+1
Senior AI Research Engineer: LLM Training & Inference Infra
Senior AI Research Engineer: LLM Training & Inference Infra

Academic Key • Paris

On-site
EUR 120,000 - 180,000
RSUs
ESPP
Conference attendance
Senior AI Research Engineer - LLM Training & Inference Infrastructure
Senior AI Research Engineer - LLM Training & Inference Infrastructure

Academic Key • Paris

On-site
EUR 120,000 - 180,000
RSUs
ESPP
Conference attendance
Senior AI GPU Kernel Engineer - LLM Training
Senior AI GPU Kernel Engineer - LLM Training

Academic Key • Paris

Hybrid
EUR 120,000 - 180,000
Hybrid work model
Senior AI Research Engineer - GPU Systems & Kernels
Senior AI Research Engineer - GPU Systems & Kernels

Academic Key • Paris

Hybrid
EUR 120,000 - 180,000
Hybrid work model
Senior Software Engineer, Autonomous Ops & AI Systems
Senior Software Engineer, Autonomous Ops & AI Systems

Datadog, Inc. • Paris

Hybrid
EUR 100,000 - 160,000
New hire stock equity (RSUs)
Employee stock purchase plan (ESPP)
Professional development
+4
Senior AI Research Engineer — GPU Kernels & LLM Training
Senior AI Research Engineer — GPU Kernels & LLM Training

ContentBuffer • Paris

Hybrid
EUR 90,000 - 120,000
Senior AI Research Engineer - GPU Systems & Kernels
Senior AI Research Engineer - GPU Systems & Kernels

Datadog, Inc. • Paris

Hybrid
EUR 90,000 - 130,000
Senior AI Research Engineer - LLM Training & Inference Infrastructure
Senior AI Research Engineer - LLM Training & Inference Infrastructure

Datadog, Inc. • Paris

Hybrid
EUR 100,000 - 140,000
Stock options
Conference opportunities
Mentor program
+1
Senior AI GPU Kernel Engineer — Hybrid, Paris
Senior AI GPU Kernel Engineer — Hybrid, Paris

Datadog, Inc. • Paris

Hybrid
EUR 90,000 - 130,000