Senior Staff TPU Architect - AI Hardware Co-Design

Google LLC; Sunnyvale (CA); On-site; USD 240,000 - 333,000; Full time

Job summary

Google is seeking a Senior Staff Performance Codesign Engineer for TPU in Sunnyvale, CA. You’ll shape TPU architecture, drive hardware-software co-design, and lead performance modeling and simulation efforts for massive ML workloads.

You’ll collaborate across research, hardware, and software teams to set roadmaps, validate designs, and push scalable, power-efficient accelerators powering Google's AI services.

Qualifications

• Bachelor's degree in Electrical Engineering, Computer Engineering, Computer Science, a related field, or equivalent practical experience.
• 12 years of experience in computer architecture, chip architecture, or hardware-software co-design.
• Experience developing systems for performance modeling, simulation, or system analysis.

Responsibilities

• Define and drive the technical roadmap and architecture for the hardware/software stack, ensuring unparalleled performance for the training and serving of large ML models.
• Act as the technical liaison between advanced research, software, and hardware teams, steering model architecture innovation to maximize scaling, quality, and hardware efficiency.
• Architect and oversee the development of next-generation configurable simulation frameworks and cycle-accurate performance models, setting the standard for how the organization evaluates complex micro-architectural decisions.
• Advocate system-level performance analysis across highly distributed ML systems, innovating new methodologies to balance compute, memory bandwidth, and inter-chip network requirements.
• Manage cross-functional partnerships across hardware engineering, compiler development, and ML research to influence broad organizational strategy and transition paradigm-shifting concepts into production.

Skills

Computer architecture

Chip architecture

Hardware-software co-design

Performance modeling

Simulation

System analysis

Education

Bachelor's degree in Electrical Engineering, Computer Engineering, Computer Science, a related field, or equivalent practical experience

Job description

Google is seeking a Senior Staff Performance Codesign Engineer for TPU in Sunnyvale, CA. You’ll shape TPU architecture, drive hardware-software co-design, and lead performance modeling and simulation efforts for massive ML workloads.

You’ll collaborate across research, hardware, and software teams to set roadmaps, validate designs, and push scalable, power-efficient accelerators powering Google's AI services.