Senior AI Hardware Codesign Engineer – TPU & ML Inference

Google; Sunnyvale (CA); On-site; USD 163,000 - 236,000; Full time

Job summary

Google seeks a Senior Performance Co-Design Engineer to shape AI/ML hardware acceleration and TPU technology. You will verify complex digital designs with a focus on TPU integration into AI/ML systems and collaborate with hardware architects on accelerator evolution.

You will analyze serving performance for emerging models, develop advanced tools, and partner across teams to optimize latency and throughput for LLM inference on Google's custom hardware.

Qualifications

• Bachelor's degree in EE/CE/CS or equivalent practical experience.
• 8 years of experience in performance modeling, computer architecture, codesign, or systems engineering.
• Experience programming in C++ or Python.

Responsibilities

• Conduct comprehensive serving performance studies on current and emerging LLMs.
• Develop and maintain simulation, profiling, and modeling tools to identify bottlenecks.
• Partner with model researchers, software, and hardware teams to co-design architectural improvements.
• Drive data-backed decisions impacting TPU and Cloud Silicon architectures.

Skills

C++

Python

Performance modeling

Computer architecture

Codesign

Systems engineering

Education

Bachelor's degree or equivalent

Master's or PhD preferred

Tools

Profiling tools

ML tooling

DL/inference optimizations

Job description

Google seeks a Senior Performance Co-Design Engineer to shape AI/ML hardware acceleration and TPU technology. You will verify complex digital designs with a focus on TPU integration into AI/ML systems and collaborate with hardware architects on accelerator evolution.

You will analyze serving performance for emerging models, develop advanced tools, and partner across teams to optimize latency and throughput for LLM inference on Google's custom hardware.