Senior GPU Kernel Engineer for AI Training & Inference

Datadog, Inc.

Paris

Hybrid

EUR 90,000 - 150,000

Full time

7 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Datadog AI Research (DAIR) seeks a Research Engineer to accelerate large-scale model training and inference by writing and tuning GPU kernels, and removing memory and communication bottlenecks on the latest GPUs. You will work at the stack’s lowest level, collaborating with researchers to implement efficient, scalable architectures for Mixture-of-Experts models.

The role blends systems programming with cutting-edge ML research.

Qualifications

  • Depth in GPU kernel development or optimization, low-latency communication, or large-scale training infrastructure.
  • Ability to reason about hardware constraints and identify bottlenecks.
  • Proficiency in a systems language (C++, Rust, or CUDA C) and Python.
  • Strong debugging and profiling skills, using tools like Nsight.

Responsibilities

  • Write, tune, and debug GPU kernels for LLM training and inference.
  • Optimize for latest NVIDIA GPUs, memory hierarchy, tensor cores, FP8/FP4 formats.
  • Reduce communication costs in distributed workloads and overlap with compute across NVLink and nodes.
  • Profile end-to-end training workloads and quantify bottlenecks.
  • Build benchmarks, profiling tools, and regression tests to guide optimization.
  • Collaborate with Research Scientists to implement new model architectures.
  • Explore low-precision training, speculative decoding, and fused/persistent kernels.

Skills

GPU kernel development
low-latency communication
systems programming (C++, Rust, CUDA)
Python
debugging & profiling
design & performance trade-offs

Tools

CUDA
Nsight
NCCL
NVSHMEM
Triton
CUTLASS
Megatron-LM / TorchTitan / DeepSpeed

Job description

Datadog AI Research (DAIR) seeks a Research Engineer to accelerate large-scale model training and inference by writing and tuning GPU kernels, and removing memory and communication bottlenecks on the latest GPUs. You will work at the stack’s lowest level, collaborating with researchers to implement efficient, scalable architectures for Mixture-of-Experts models.

The role blends systems programming with cutting-edge ML research.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Research Engineer — GPU Kernels & LLM Training
Senior AI Research Engineer — GPU Kernels & LLM Training

ContentBuffer • Paris

Hybrid
EUR 90,000 - 120,000
Senior AI GPU Kernel Engineer - LLM Training
Senior AI GPU Kernel Engineer - LLM Training

Academic Key • Paris

Hybrid
EUR 120,000 - 180,000
Hybrid work model
Senior AI GPU Kernel Engineer — Hybrid, Paris
Senior AI GPU Kernel Engineer — Hybrid, Paris

Datadog, Inc. • Paris

Hybrid
EUR 90,000 - 130,000
Senior AI Research Engineer - GPU Systems & Kernels
Senior AI Research Engineer - GPU Systems & Kernels

Datadog, Inc. • Paris

Hybrid
EUR 90,000 - 150,000
Senior AI Research Engineer - GPU Systems & Kernels
Senior AI Research Engineer - GPU Systems & Kernels

Academic Key • Paris

Hybrid
EUR 120,000 - 180,000
Hybrid work model
Senior AI Research Engineer - GPU Systems & Kernels
Senior AI Research Engineer - GPU Systems & Kernels

Datadog, Inc. • Paris

Hybrid
EUR 90,000 - 130,000
D Senior AI Research Engineer - GPU Systems & Kernels datadoghq.com · Paris, FR Python Rust C++
D Senior AI Research Engineer - GPU Systems & Kernels datadoghq.com · Paris, FR Python Rust C++

ContentBuffer • Paris

Hybrid
EUR 90,000 - 120,000
Senior AI Research Engineer: LLM Training & Inference Infra
Senior AI Research Engineer: LLM Training & Inference Infra

Academic Key • Paris

On-site
EUR 120,000 - 180,000
RSUs
ESPP
Conference attendance
GPU Engineer - Real-Time AI Inference & Kernel Optimization
GPU Engineer - Real-Time AI Inference & Kernel Optimization

Kog • Paris

On-site
EUR 85,000 - 115,000
Senior AI Systems Engineer, Large-Scale Infra
Senior AI Systems Engineer, Large-Scale Infra

Datadog, Inc. • Paris

Hybrid
EUR 100,000 - 140,000
Stock options
Conference opportunities
Mentor program
+1