Machine Learning Engineer — GPU Kernel

Lever, Inc.; Sunnyvale (CA); On-site; USD 150,000 - 450,000; Full time

Benefits offered by this job

Comprehensive medical, dental, and视觉 V

Bonus

401K Plan

Generous paid time off, sick leave and

Paid Parental Leave

Employee Assistance Program

Life insurance and disability

Job summary

MBZUAI is seeking a GPU Kernel Engineer to optimize machine learning software stacks for training and inference on state-of-the-art hardware. You will work on CUDA kernel development, profiling, and performance tuning, with opportunities to lead design reviews and contribute to documentation.

The role emphasizes hands-on system-level coding, parallel computing, and large-scale ML experience, with distributed training as a plus. Collaboration with the institute’s HPC teams is expected.

Qualifications

• Strong C++ and CUDA kernel development experience for deep-learning workloads.
• Proficiency in Python and integrating kernels with PyTorch or similar frameworks.
• Experience profiling and optimizing GPU kernels with performance-focused mindset.

Responsibilities

• Understand, profile, optimize and guide deep learning workloads on state-of-the-art hardware and software platforms.
• Design and implement performance benchmarks and testing methodologies.
• Build tools to automate workload analysis and optimization.

Skills

C++ programming

CUDA kernel development

Python with PyTorch integration

Tools

Triton

CUTLASS

PTX/SASS analysis

Job description

About the Institute of Foundation Models

We are a dedicated research lab for building, understanding, using, and risk-managing foundation models. Our mandate is to advance research, nurture the next generation of AI builders, and drive transformative contributions to a knowledge-driven economy.

The Role

The GPU Kernel Engineer will play a role at the forefront of optimizing performance for the machine learning software stacks, especially at training and inference, and support the team to develop new and cutting-edge systems. The ideal candidate will have a strong background in parallel computing, and hands-on experience in system level coding, debug methodologies, and large-scale machine learning experience.

This role focuses on CUDA kernel development and optimization. Distributed training experience is a plus.

Key Responsibilities

• Understand, analyze, profile, optimize, and provide guidance to the team on deep learning workloads on state-of-the-art hardware and software platforms to improve their efficiency with different levels of optimization
• Design and implement performance benchmarks and testing methodologies to evaluate application performance
• Build tools to automate workload analysis, workload optimization, and other critical workflows
• Triage system issues and identify bottleneck and inefficiencies by analyzing the sources of issues and the impact on hardware, network and propose solutions to enhance GPU utilization
• Support the team to develop appropriate kernels and systems for new model architectures and algorithms
• Participate in, or lead design reviews with peers and stakeholders to decide amongst available technologies.
• Review code developed by other developers and provide feedback to ensure best practices (e.g., style guidelines, checking code in, accuracy, testability, and efficiency).
• Contribute to existing documentation or educational content and adapt content based on product/program updates and user feedback.
• Represent MBZUAI at industry conferences and events, showcasing the institution’s cutting-edge HPC anddeep learning capabilities and establishing MBZUAI as a global leader in AI research and innovation.
• Perform all other duties as reasonably directed by the line manager that are commensurate with thesefunctional objectives.
• Validate CUDA kernel outputs and gradients against reference implementations, and benchmark representative shapes, dtypes, and model workloads.

Technical Qualifications

Must-Haves:

• Strong C++ skills and hands-on CUDA kernel development and optimization for deep-learning workloads.
• Understanding of GPU memory hierarchy, warp/block execution, and compute-memory trade-offs, with demonstrated profiling-driven optimization.
• Strong Python skills and experience integrating kernels with PyTorch or an equivalent framework, including numerical and gradient validation where needed.

Nice-to-Haves:

• Experience with Triton, CUTLASS, or PTX/SASS analysis.
• Experience with multi-node distributed training or inference systems.
• Experience validating mixed-precision computations, such as BF16 or FP8.

$150,000 - $450,000 a year

The posted salary range represents the company’s good faith estimate of the compensation for this position upon hire. The actual compensation offered may vary within this range depending on individual qualifications, including but not limited to relevant skills, experience, education, certifications, geographic location, and specific business needs.

Benefits Include

• Comprehensive medical, dental, and vision benefits
• Bonus
• 401K Plan
• Generous paid time off, sick leave and holidays
• Paid Parental Leave
• Employee Assistance Program
• Life insurance and disability