MS/PhD, AI-driven ML Performance Engineering Intern (2027 Summer Intern)

Waymo LLC; Mountain View (CA); Hybrid; USD 55,000 - 83,000; Part time

Benefits offered by this job

Hybrid work model with remote work

Educational reimbursement

On-site meals and snacks

Competitive compensation

Job summary

Waymo LLC is seeking a highly capable intern to design and optimize kernels for a transformer inference workload on Waymo’s ML accelerators. You will work with AI agents to push the performance of a Domain-Specific Language for a custom accelerator, ensuring correctness and numerical accuracy throughout development.

You will analyze bottlenecks, validate results, and build tooling to automate kernel generation, enabling iterative improvements with minimal human intervention.

Qualifications

• Working knowledge of kernels for transformer inference and performance analysis.
• Familiarity with low-level ML accelerator DSLs (CUDA, Triton, Gluon).
• Fluency in Python and/or C++.
• Currently enrolled in an MS or PhD program in Computer Science, Computer Engineering, Computational Science, or related quantitative field.

Responsibilities

• Collaborate with AI agents to develop high-performance low-level kernels for a custom ML accelerator DSL.
• Ensure functional correctness and numerical accuracy of kernels.
• Conduct performance analyses to identify bottlenecks and optimization opportunities.
• Develop a harness to iteratively improve kernel generation and reduce manual tuning.

Skills

Python

C++

Kernel optimization

Performance analysis

AI agent harnesses

Education

MS or PhD in Computer Science/Computer Engineering/Computational Science

Tools

CUDA

Triton

Gluon

Job description

• We are a team that designs and implements the hardware, compiler, and software frameworks for the ML accelerators in Waymo’s custom silicon. The team’s expertise spans all phases of custom accelerator production from architecture through software integration, and leverages Waymo’s decades of experience to optimize the design space for the needs of our autonomous driving software
• Waymo interns partner with leaders in the industry on projects that create impact to the company. We believe learning is a two-way street: applying your knowledge while providing you with opportunities to expand your skill-set. Interns are an important part of our culture and our recruiting pipeline. Join us at Waymo for a fun and rewarding internship!
• Work with AI agents to create high performance low-level kernels in a Domain-Specific language for a custom ML accelerator
• Ensure functional correctness and numerical accuracy of kernels
• Conduct performance analysis of the kernels to identify performance bottlenecks and areas that need improvement
• Develop a custom harness to recursively improve kernel generation and remove the need for human involvement

Benefits

• Medical, dental, and vision insurance for employees and dependents
• Employee assistance programs focused on mental health
• Personalized workplace adjustments for diverse needs and abilities, including physical, mental, and neurodivergent considerations
• Access to mental health apps
• Onsite wellness centers
• Second medical opinion for you and your loved ones
• Medical advocacy program for transgender employees
• Support programs including menopause benefit
• Counseling services
• Competitive compensation
• Regular bonus and equity performance grant opportunities
• Generous 401(k) and regional retirement plans
• 1-on-1 financial coaching
• Annual cross-company compensation review and pay equity analysis
• Fertility and growing family assistance
• Parental leave and baby bonding leave
• Elder care and support
• Survivor income benefit
• Backup childcare
• Caregiver leave
• Paid time off, including vacation, bereavement, sick leave, parental leave, disability, and holidays
• Jury duty leave
• Military leave
• Hybrid work model with remote work opportunities also available
• Educational reimbursement
• Peer learning and coaching platform
• Donation matching programs
• Employee resource groups
• Volunteer hours
• Internal community groups and local culture clubs
• Inspiring spaces to work, recharge, and collaborate with fellow Waymonauts
• On-site meals and snacks
• Fitness centers, massage programs, and ergonomic support
• On-demand fitness, wellbeing, and cooking classes
• Commuter benefits

Working knowledge of key kernels for transformer inference including performance analysis and optimizationFamiliarity with one or more low-level ML accelerator DSLs (CUDA, Triton, Gluon, etc.)Currently enrolled in an MS or PhD program in Computer Science, Computer Engineering, Computational Science, or a related quantitative fieldDemonstrated track record of using AI agents and harnesses to improve coding performanceSolid understanding of modern inference accelerator architecturesFluency in Python and/or C++Working knowledge of different ML numerical formats and their relative accuracy vs performance tradeoffs