GPU Kernel Engineer for High-Performance AI Inference

Baseten; New York (NY); On-site; USD 180,000 - 360,000; Full time

Benefits offered by this job

100% coverage of medical, dental, and vision insurance

Flexible PTO policy

Paid parental leave

Fertility and family-building stipend

Company-facilitated 401(k)

Job summary

Baseten is seeking a GPU Kernel Engineer in New York, NY. The ideal candidate will design high-performance GPU kernels and optimize computation for AI workloads. Responsibilities include implementing advanced features, contributing to open-source GPU libraries, and collaborating with research teams. The position offers competitive compensation, 100% coverage of insurance, and flexible PTO. Join Baseten to be part of cutting-edge AI acceleration efforts.

Qualifications

• Deep understanding of GPU memory hierarchy and thread organization.
• Experience optimizing GPU code for performance.
• Knowledge of memory access patterns and thread synchronization.

Responsibilities

• Design high-performance GPU kernels for ML operations.
• Optimize code using CUDA and architecture-specific techniques.
• Resolve performance bottlenecks in GPU applications.

Skills

Strong understanding of GPU architecture

Proficient in C++

Knowledge of CUDA C++ API

Experience with numerical precision

Familiarity with performance profiling tools

Tools

CUDA

Nsight Systems

Torch Profiler

Cutlass

Triton

Job description

Baseten is seeking a GPU Kernel Engineer in New York, NY. The ideal candidate will design high-performance GPU kernels and optimize computation for AI workloads. Responsibilities include implementing advanced features, contributing to open-source GPU libraries, and collaborating with research teams. The position offers competitive compensation, 100% coverage of insurance, and flexible PTO. Join Baseten to be part of cutting-edge AI acceleration efforts.