Senior GPU Performance Engineer — Optimize AI Accelerators

Google; United States; On-site; USD 174,000 - 253,000; Full time

Benefits offered by this job

Health, dental, vision, life insurance

401(k) with company match

Paid Time Off: 20 days/year

Job summary

Google Sunnyvale, CA, USA is seeking a Senior Software Engineer, GPU Performance to optimize GPU workloads and advance AI acceleration across products. You will collaborate with ML, compiler, and systems teams to push the limits of GPU software and architecture.

Ideal candidates have strong GPU programming experience, knowledge of CUDA/Triton, and a track record in deploying LLMs on accelerators, with mentoring responsibilities for junior engineers. Compensation includes equity and benefits.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 5 years of experience with software development in one or more programming languages.
• 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
• Experience with modern GPU architectures (NVIDIA, AMD, or other AI accelerators), memory hierarchies, and performance bottlenecks.
• Experience low-level GPU programming (CUDA, Triton, CUTLASS, etc.) and performance engineering techniques.
• Experience with modern LLMs and their deployment on AI accelerators.

Responsibilities

• Build optimizations for the latest generation of GPUs powering Google’s products and services.
• Address performance bottlenecks through GPU tooling and accelerators.
• Drive optimizations across Google’s GPU software stack, from compilers to kernels.
• Influence the GPU software direction by collaborating with ML, compiler design, and systems teams.
• Influence deployment of Google's GPU fleet with product teams.

Skills

GPU architectures

CUDA/Triton

Performance engineering

LLMs deployment

Low-level GPU programming

Mentoring

Education

Bachelor's degree or equivalent practical experience

Master's degree or PhD in CS or related field

Tools

CUDA

Triton

CUTLASS

OpenXLA

MLIR

Job description

Google Sunnyvale, CA, USA is seeking a Senior Software Engineer, GPU Performance to optimize GPU workloads and advance AI acceleration across products. You will collaborate with ML, compiler, and systems teams to push the limits of GPU software and architecture.

Ideal candidates have strong GPU programming experience, knowledge of CUDA/Triton, and a track record in deploying LLMs on accelerators, with mentoring responsibilities for junior engineers. Compensation includes equity and benefits.