Senior AI Research Engineer — GPU Kernels & LLM Training

ContentBuffer

Paris

Hybrid

EUR 90,000 - 120,000

Full time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Datadog is seeking a Research Engineer for the Frontier Foundations team to push the limits of large-scale model training and inference. You will write and tune GPU kernels, optimize memory and communication bottlenecks, and work on latest GPUs to accelerate Mixture-of-Experts workloads.

You will partner with Research Scientists to translate new model architectures into efficient implementations while exploring low-precision techniques and fused kernels.

Qualifications

  • Experience in GPU kernel development and optimization.
  • Experience with low-latency communication and collective operations.
  • Proficiency in C++, Rust, or CUDA C and Python.
  • Strong debugging and profiling skills with tools such as Nsight.

Responsibilities

  • Write, tune, and debug GPU kernels for LLM training and inference.
  • Optimize for NVIDIA GPU generations, including memory hierarchy and tensor cores; FP8/FP4 formats.
  • Reduce communication costs in distributed workloads and overlap with compute.
  • Profile end-to-end workloads and build benchmarks and regression tests.
  • Collaborate with Research Scientists to implement new model architectures.
  • Explore low-precision training and fused/persistent kernels.

Skills

GPU kernel development
Low-latency communication
Large-scale training infrastructure
C++
Rust
CUDA C
Python
Nsight

Tools

NCCL
NVSHMEM
Triton
CUTLASS
Megatron-LM
TorchTitan
DeepSpeed

Job description

Datadog is seeking a Research Engineer for the Frontier Foundations team to push the limits of large-scale model training and inference. You will write and tune GPU kernels, optimize memory and communication bottlenecks, and work on latest GPUs to accelerate Mixture-of-Experts workloads.

You will partner with Research Scientists to translate new model architectures into efficient implementations while exploring low-precision techniques and fused kernels.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior GPU Kernel Engineer for AI Training & Inference
Senior GPU Kernel Engineer for AI Training & Inference

Datadog, Inc. • Paris

Hybrid
EUR 90,000 - 150,000
Senior AI GPU Kernel Engineer - LLM Training
Senior AI GPU Kernel Engineer - LLM Training

Academic Key • Paris

Hybrid
EUR 120,000 - 180,000
Hybrid work model
Senior AI GPU Kernel Engineer — Hybrid, Paris
Senior AI GPU Kernel Engineer — Hybrid, Paris

Datadog, Inc. • Paris

Hybrid
EUR 90,000 - 130,000
Senior AI Research Engineer - GPU Systems & Kernels
Senior AI Research Engineer - GPU Systems & Kernels

Datadog, Inc. • Paris

Hybrid
EUR 90,000 - 150,000
Senior AI Research Engineer - GPU Systems & Kernels
Senior AI Research Engineer - GPU Systems & Kernels

Academic Key • Paris

Hybrid
EUR 120,000 - 180,000
Hybrid work model
Senior AI Research Engineer - GPU Systems & Kernels
Senior AI Research Engineer - GPU Systems & Kernels

Datadog, Inc. • Paris

Hybrid
EUR 90,000 - 130,000
D Senior AI Research Engineer - GPU Systems & Kernels datadoghq.com · Paris, FR Python Rust C++
D Senior AI Research Engineer - GPU Systems & Kernels datadoghq.com · Paris, FR Python Rust C++

ContentBuffer • Paris

Hybrid
EUR 90,000 - 120,000
Senior AI Systems Engineer, Large-Scale Infra
Senior AI Systems Engineer, Large-Scale Infra

Datadog, Inc. • Paris

Hybrid
EUR 100,000 - 140,000
Stock options
Conference opportunities
Mentor program
+1
Senior AI Research Engineer: LLM Training & Inference Infra
Senior AI Research Engineer: LLM Training & Inference Infra

Academic Key • Paris

On-site
EUR 120,000 - 180,000
RSUs
ESPP
Conference attendance
Senior LLM Infrastructure Engineer - Training & Inference
Senior LLM Infrastructure Engineer - Training & Inference

Datadog, Inc. • Paris

On-site
EUR 120,000 - 180,000
RSUs and ESPP
Conference attendance
Mentor program
+1