TPU Hardware–Software Co-Design Engineer

Google LLC; Sunnyvale (CA); On-site; USD 192,000 - 278,000; Full time

Job summary

Google Sunnyvale, CA is seeking a Hardware/Software Co-Design Engineer, Inference to shape AI/ML hardware acceleration and TPU architecture. You’ll bridge model innovations with next-generation silicon, collaborating across AI research, hardware designers, and software teams.

You will drive integration of ML research and advanced silicon architectures, delivering high-performance, power-efficient accelerators for serving and training workloads at scale.

Qualifications

• Bachelor's degree in Electrical Engineering, Computer Engineering, Computer Science, or a related field, or equivalent practical experience.
• 10 years of experience in computer architecture, chip architecture, or hardware-software co-design.
• Experience developing systems for performance modeling, simulation, or system analysis.

Responsibilities

• Drive the definition and optimization of the hardware/software stack to enable performant training and serving of large ML models.
• Collaborate with research and modeling teams to innovate on model architectures, focusing on scaling, quality, and their direct impact on hardware performance.
• Lead the development of configurable architectural simulators and cycle-accurate performance models to quantify microarchitectural optimizations and evaluate architectural decisions.
• Conduct system-level performance analysis across highly distributed ML systems, innovating new methodologies to balance compute, memory bandwidth, and inter-chip network requirements.
• Engage with partners across hardware design, compiler development, and ML research to transition architectural innovations from concept to production.

Skills

Computer architecture

Hardware-software co-design

Performance modeling

ML frameworks

Cross-functional collaboration

Education

Bachelor's degree in ECE/CS/related field

Master's or PhD in ECE/CS/related field

Tools

TensorFlow

PyTorch

Job description

Google Sunnyvale, CA is seeking a Hardware/Software Co-Design Engineer, Inference to shape AI/ML hardware acceleration and TPU architecture. You’ll bridge model innovations with next-generation silicon, collaborating across AI research, hardware designers, and software teams.

You will drive integration of ML research and advanced silicon architectures, delivering high-performance, power-efficient accelerators for serving and training workloads at scale.