Senior AI GPU Kernel Engineer — Hybrid, Paris

Datadog, Inc.

Paris

Hybrid

EUR 90,000 - 130,000

Full time

7 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Datadog, Inc. is seeking a Research Engineer for the Frontier Foundations team in Paris to accelerate large-scale model training and inference by writing and tuning GPU kernels and removing memory and communication bottlenecks on the latest GPUs.

You will collaborate with Research Scientists to translate new model architectures into efficient implementations, optimize for NVIDIA GPUs, and explore techniques like low-precision training and fused kernels.

Qualifications

  • Experience in GPU kernel development or optimization.
  • Proficient in C++/Rust/CUDA C and Python.
  • Strong debugging and profiling skills.
  • Ability to explain design and performance trade-offs.

Responsibilities

  • Write, tune, and debug GPU kernels for LLM training and inference.
  • Optimize for NVIDIA GPUs including memory hierarchies and tensor cores.
  • Reduce communication costs in distributed workloads.
  • Profile end-to-end training and identify bottlenecks.
  • Build benchmarks, profiling tools, and regression tests.
  • Collaborate with Research Scientists to implement new model architectures.
  • Explore low-precision training and fused or persistent kernels.

Skills

GPU kernel development
Low-latency communication
Large-scale training infrastructure
Systems language (C++, Rust, or CUDA C
Python
Debugging and profiling
Explain design trade-offs

Tools

Nsight
NCCL
NVSHMEM
Triton
CUTLASS
DeepSpeed

Job description

Datadog, Inc. is seeking a Research Engineer for the Frontier Foundations team in Paris to accelerate large-scale model training and inference by writing and tuning GPU kernels and removing memory and communication bottlenecks on the latest GPUs.

You will collaborate with Research Scientists to translate new model architectures into efficient implementations, optimize for NVIDIA GPUs, and explore techniques like low-precision training and fused kernels.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI GPU Kernel Engineer - LLM Training
Senior AI GPU Kernel Engineer - LLM Training

Academic Key • Paris

Hybrid
EUR 120,000 - 180,000
Hybrid work model
Senior AI Research Engineer — GPU Kernels & LLM Training
Senior AI Research Engineer — GPU Kernels & LLM Training

ContentBuffer • Paris

Hybrid
EUR 90,000 - 120,000
Senior GPU Kernel Engineer for AI Training & Inference
Senior GPU Kernel Engineer for AI Training & Inference

Datadog, Inc. • Paris

Hybrid
EUR 90,000 - 150,000
Senior AI Research Engineer - GPU Systems & Kernels
Senior AI Research Engineer - GPU Systems & Kernels

Datadog, Inc. • Paris

Hybrid
EUR 90,000 - 130,000
Paris GPU Engineer for AI Agents & Kernels
Paris GPU Engineer for AI Agents & Kernels

Kog • Paris

On-site
EUR 70,000 - 110,000
Senior AI Research Engineer - GPU Systems & Kernels
Senior AI Research Engineer - GPU Systems & Kernels

Academic Key • Paris

Hybrid
EUR 120,000 - 180,000
Hybrid work model
GPU Compute Infrastructure Engineer – Paris (Hybrid)
GPU Compute Infrastructure Engineer – Paris (Hybrid)

H Company • Paris

Hybrid
EUR 90,000 - 130,000
Senior AI Systems Engineer, Large-Scale Infra
Senior AI Systems Engineer, Large-Scale Infra

Datadog, Inc. • Paris

Hybrid
EUR 100,000 - 140,000
Stock options
Conference opportunities
Mentor program
+1
Senior AI Research Engineer - GPU Systems & Kernels
Senior AI Research Engineer - GPU Systems & Kernels

Datadog, Inc. • Paris

Hybrid
EUR 90,000 - 150,000
Senior AI Research Engineer: LLM Training & Inference Infra
Senior AI Research Engineer: LLM Training & Inference Infra

Academic Key • Paris

On-site
EUR 120,000 - 180,000
RSUs
ESPP
Conference attendance