Performance Kernel Engineer for AI Inference Accelerators

Darwin Recruitment

San Francisco (CA)

On-site

USD 170,000 - 250,000

Full time

4 days ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Darwin Recruitment is seeking a skilled kernel development engineer to own low level kernels for AI model inference workloads. You will craft high performance matrix and attention kernels and collaborate with compiler and architecture teams to optimize speed for the next generation of chips.

Applicants should have strong C++ and low level optimization experience (CUDA or similar), deep knowledge of memory hierarchies, parallelism and profiling, and a proven record of speed ups.

Qualifications

  • Strong C++ and low level optimization experience (CUDA or similar).
  • Knowledge of memory hierarchies, parallelism and profiling.
  • A track record of measurable speed ups.

Responsibilities

  • Develop high performance kernels for matrix and attention workloads
  • Profile and remove bottlenecks across compute and memory
  • Build the kernel library and benchmarking tools
  • Feed results back to the architecture team

Skills

C++
Low-level optimization
CUDA or similar
Profiling & optimization

Job description

Darwin Recruitment is seeking a skilled kernel development engineer to own low level kernels for AI model inference workloads. You will craft high performance matrix and attention kernels and collaborate with compiler and architecture teams to optimize speed for the next generation of chips.

Applicants should have strong C++ and low level optimization experience (CUDA or similar), deep knowledge of memory hierarchies, parallelism and profiling, and a proven record of speed ups.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Performance Engineer
Performance Engineer

Darwin Recruitment • San Francisco (CA)

On-site
USD 170,000 - 250,000
Senior Kernel Optimization Engineer for AI Hardware
Senior Kernel Optimization Engineer for AI Hardware

Cerebras • United States

Remote
USD 140,000 - 180,000
Staff Kernel Optimzation Engineer
Staff Kernel Optimzation Engineer

Cerebras • United States

Remote
USD 140,000 - 180,000
AI Inference Kernel Optimization Engineer
AI Inference Kernel Optimization Engineer

Vidman AI • United States

Remote
USD 140,000 - 210,000
Remote Kernel Performance Engineer – AI Inference
Remote Kernel Performance Engineer – AI Inference

Inferact • San Francisco (CA)

Remote
USD 200,000 - 400,000
Health benefits including vision, and
401(k) company match
GPU Kernel Engineer for Fast AI Training & Inference
GPU Kernel Engineer for Fast AI Training & Inference

River AI • Palo Alto (CA)

On-site
USD 200,000 - 420,000
Equity
Visa sponsorship
Relocation assistance
+1
GPU/Kernel Engineer
GPU/Kernel Engineer

Acceler8 Talent • Palo Alto (CA)

On-site
USD 180,000 - 240,000
GPU Kernel Engineer - High-Performance ML Acceleration
GPU Kernel Engineer - High-Performance ML Acceleration

Baseten • Seattle (WA)

On-site
USD 180,000 - 360,000
Kernel Engineer for AI Hardware & HPC
Kernel Engineer for AI Hardware & HPC

Cerebras • Sunnyvale (CA)

On-site
USD 180,000 - 240,000
GPU Kernel Engineer – AI Inference & CUDA Optimizations
GPU Kernel Engineer – AI Inference & CUDA Optimizations

FriendliAI Inc. • San Francisco (CA)

On-site
USD 180,000 - 240,000
Flexible working hours
Daily meals / snacks provided
Health insurance
+2