Generative AI Accelerator Architect and Performance Architect

Google; San Diego (CA); On-site; USD 192,000 - 278,000; Full time

Benefits offered by this job

Equity

Job summary

Google is seeking a seasoned hardware architect to lead GenAI ML architecture exploration for Tensor mobile SoCs. You will collaborate with research, system architecture, and compiler teams to drive future workloads across hardware and software.

The role requires deep expertise in AI model architectures and proficiency in C/C++/Python, with emphasis on power and performance. Individual pay is determined by factors including skills and education.

Qualifications

• Bachelor's degree in Computer Science, Electrical Engineering or a related field, or equivalent practical experience.
• 10 years of work or academic research experience in computer or chip architecture, performance, or compiler.
• Experience with modern Generative AI model architectures (e.g., Large Language Models, Vision Transformers, Image Diffusion Models, etc.).
• Experience with one or more general purpose programming languages (e.g., C, C++, or Python) and deep learning frameworks (e.g., TensorFlow, JAX, or PyTorch).

Responsibilities

• Drive GenAI ML architecture exploration for Tensor mobile SoCs with researchers and engineers to optimize future workloads across the tech stack.
• Define system architecture requirements for future Generative AI use cases with PM teams.
• Apply advanced research to achieve power and performance gains on Generative AI workloads.
• Optimize model scheduling on the TPU compute engines to improve GenAI performance.

Skills

Generative AI architectures

C/C++/Python

Deep learning frameworks

Education

Bachelor's degree in CS/EE or related field

Master's or PhD in CS/EE

Job description

In most instances, this position requires in-person interviews as part of the hiring process.

Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Mountain View, CA, USA; San Diego, CA, USA.

Minimum qualifications

• Bachelor's degree in Computer Science, Electrical Engineering or a related field, or equivalent practical experience.
• 10 years of work or academic research experience in computer or chip architecture, performance, or compiler.
• Experience with modern Generative AI model architectures (e.g., Large Language Models, Vision Transformers, Image Diffusion Models, etc.).
• Experience with one or more general purpose programming languages (e.g., C, C++, or Python) and deep learning frameworks (e.g., TensorFlow, JAX, or PyTorch).

Preferred qualifications

• Master's or PhD degree in Computer Science or Electrical Engineering.
• Experience in compute IP (NPU/TPU, GPU) development, system PnP modeling and thermal/power analysis.
• Experience with design space explorations and hardware/software co-design for machine learning.
• Proven track record in driving medium to large scale projects and result delivery.
• Excellent communication skills.

About The Job

Be part of a team that pushes boundaries, developing custom silicon solutions that power the future of Google's direct-to-consumer products. You'll contribute to the innovation behind products loved by millions worldwide. Your expertise will shape the next generation of hardware experiences, delivering unparalleled performance, efficiency, and integration.

Google's mission is to organize the world's information and make it universally accessible and useful. Our team combines the best of Google AI, Software, and Hardware to create radically helpful experiences. We research, design, and develop new technologies and hardware to make computing faster, seamless, and more powerful. We aim to make people's lives better through technology.

Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

US: $192000 - $278000 (USD) + 20% bonus target + equity + benefits

Responsibilities

Learn more about benefits at Google .

• Drive forward-looking GenAI ML architecture exploration for Tensor mobile SoCs while collaborating with research teams, system architecture teams, and compiler engineers to optimize future workloads from both all perspectives across the tech stack including hardware, software, use case, network, and external components.
• Work with researchers and Product Manager (PM) teams to define system architecture requirements for future Generative AI use cases.
• Apply advanced research in architecture and process technology to get breakthrough power and performance improvements on Generative AI workloads.
• Optimize performance of GenAI use cases by defining an optimal model scheduling on the TPU compute engines.

Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. See also Google's EEO Policy and EEO is the Law. If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form .