Senior Software Engineer, ML Systems & TPU Kernels

Google; Sunnyvale (CA); On-site; USD 147,000 - 210,000; Full time

Job summary

Google is seeking software engineers to help build scalable systems and AI infrastructure. The Core team designs foundational blocks across Google products, enabling safe, coherent user experiences and accelerating innovation.

You will work on high-impact projects and may switch teams as needs grow. Responsibilities include tracking AI trends, validating optimizations, and collaborating on hardware-software co-design to shape TPU architecture and model capabilities.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 2 years of software development experience in one or more programming languages.
• 2 years of experience with performance, large-scale systems data analysis, visualization tools, or debugging.
• 2 years of experience with computer architecture, performance analysis, and performance modeling.

Responsibilities

• Track the AI market, including the latest open-source models, frameworks, and research breakthroughs to identify SOTA algorithmic optimization opportunities.
• Identify and validate SOTA algorithmic optimizations (e.g., quantization, mxfp4) through white-glove projects for key internal customers.
• Drive end-to-end impact by transitioning validated algorithms and recipes to the Frontier Model Performance (manual optimization) and Automation teams, ensuring streamlined scaling.
• Collaborate on hardware/software co-design to guide future TPU architecture (e.g., nvfp4) and product capabilities.
• Develop custom kernels (Pallas) for new algorithmic efficiency techniques, and put them into production for 3P/OSS and 1P models.

Skills

Data structures

Algorithms

Co-design

Computer architecture analysis

ML models

Education

Bachelor’s degree or equivalent practical experience

Master's degree or PhD in Computer Science or related technical fields

Tools

Pallas

Job description

Google is seeking software engineers to help build scalable systems and AI infrastructure. The Core team designs foundational blocks across Google products, enabling safe, coherent user experiences and accelerating innovation.

You will work on high-impact projects and may switch teams as needs grow. Responsibilities include tracking AI trends, validating optimizations, and collaborating on hardware-software co-design to shape TPU architecture and model capabilities.