GPU Kernel Architect for Fast LLM Training & Inference

Datadog, Inc.

Paris (TX)

On-site

USD 170,000 - 210,000

Full time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Datadog, Inc. is seeking a Research Engineer for the Frontier Foundations team to accelerate large-scale model training and inference on the latest GPUs.

You will partner with Research Scientists, write and tune GPU kernels, and remove memory and communication bottlenecks to enable efficient Mixture-of-Experts workloads. You will work at the lowest levels of the stack, optimizing CUDA/Triton paths, profiling across NVLink, and collaborating to translate new model architectures into

Qualifications

  • Experience with GPU kernel development and optimization.
  • Familiarity with NVIDIA GPU architectures and memory hierarchies.
  • Proficiency in Python and systems programming (C++/Rust/CUDA C).

Responsibilities

  • Write, tune, and debug GPU kernels for training and inference.
  • Optimize for NVIDIA GPUs, memory and tensor cores.
  • Reduce communication cost in distributed workloads (NVLink, NVSHMEM, NCCL).
  • Profile end-to-end workloads and identify bottlenecks.
  • Build benchmarks and regression tests for optimization.
  • Collaborate with researchers to implement new model architectures.
  • Explore low-precision training and persistent kernel techniques.

Skills

GPU kernel dev
CUDA
Triton
NCCL
RDMA
Python
Nsight
Profiling
Large-scale training

Tools

CUTLASS
NVSHMEM
Megatron-LM
DeepSpeed
TorchTitan

Job description

Datadog, Inc. is seeking a Research Engineer for the Frontier Foundations team to accelerate large-scale model training and inference on the latest GPUs.

You will partner with Research Scientists, write and tune GPU kernels, and remove memory and communication bottlenecks to enable efficient Mixture-of-Experts workloads. You will work at the lowest levels of the stack, optimizing CUDA/Triton paths, profiling across NVLink, and collaborating to translate new model architectures into

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI GPU Kernel Engineer - High-Performance LLM Training (Hybrid)
Senior AI GPU Kernel Engineer - High-Performance LLM Training (Hybrid)

Datadog, Inc. • Paris (KY)

Hybrid
USD 150,000 - 230,000
GPU Kernel Engineer for Fast AI Training & Inference
GPU Kernel Engineer for Fast AI Training & Inference

River AI • Palo Alto (CA)

On-site
USD 200,000 - 420,000
Equity
Visa sponsorship
Relocation assistance
+1
Senior AI Research Engineer - GPU Systems & Kernels
Senior AI Research Engineer - GPU Systems & Kernels

Datadog, Inc. • Paris (TX)

On-site
USD 170,000 - 210,000
GPU Kernel Engineer — Accelerate AI Training & Inference
GPU Kernel Engineer — Accelerate AI Training & Inference

River AI Inc. • Palo Alto (CA)

On-site
USD 200,000 - 420,000
Health insurance
Dental insurance
Vision insurance
+3
Senior AI Research Engineer - GPU Systems & Kernels
Senior AI Research Engineer - GPU Systems & Kernels

Datadog, Inc. • Paris (KY)

Hybrid
USD 150,000 - 230,000
Senior AI Infra Engineer, Large-Scale ML Systems
Senior AI Infra Engineer, Large-Scale ML Systems

Datadog, Inc. • Paris (TX)

Hybrid
USD 180,000 - 240,000
Stock options
ESPP
Global collaboration across offices
+1
Performance Engineer: GPU Kernel & Inference Optimize
Performance Engineer: GPU Kernel & Inference Optimize

WORLD LABS • San Francisco (CA)

On-site
USD 200,000 - 300,000
Senior GPU Inference Kernel Engineer - Fast & Efficient AI
Senior GPU Inference Kernel Engineer - Fast & Efficient AI

Vidman AI • United States

Remote
USD 140,000 - 210,000
Senior Inference & GPU Kernel Engineer — Equity
Senior Inference & GPU Kernel Engineer — Equity

Touchdown Labs • Santa Clara (CA)

On-site
USD 200,000 - 270,000
Senior LLM Inference: GPU Kernel Optimization
Senior LLM Inference: GPU Kernel Optimization

NVIDIA Corporation • Austin (TX)

On-site
USD 184,000 - 287,500
Equity
Benefits