Sr. Staff Engineer - High-Performance Networking & AI Infra

Google; Sunnyvale (CA); On-site; USD 262,000 - 364,000; Full time

Job summary

Google Sunnyvale is seeking a Senior Staff Software Engineer to lead the evolution of the HPN stack and drive integration with high-performance storage and AI infrastructure. You will shape the efficiency, scalability, and performance of Google’s hyperscaler platform for AI/ML workloads.

You will mentor distributed teams, design scalable architectures, and partner across RDMA, storage, and AI/ML to deliver cutting-edge capabilities for Google Cloud and users worldwide.

Qualifications

• Bachelor's degree or equivalent practical experience.
• 8 years of experience programming in C++.
• 5 years in design/architecture, testing and launching software products.
• Experience with C, High Performance Computing, Remote Direct Memory Access, Storage Systems, System Design, and Kernel Drivers.

Responsibilities

• Technical Leadership and Mentorship: Lead and coach a distributed engineering team, fostering innovation while aligning cross-functional groups on goals, priorities, and deliverables.
• Large-Scale and LLM Architecture: Design and deploy scalable software and advanced serving architectures, optimizing the LLM serving stack for efficiency and reliability.
• Performance and Network Engineering: Architect performant network transport across various NICs and platforms, tuning the communication stack to accelerate HPC, RDMA, and ML workloads.
• Strategic Roadmap and Trends: Partner with cross-organizational leaders to co-develop roadmaps bridging RDMA, storage, and AI/ML, staying ahead of training and inference advancements.
• Collaborative System Integration: Collaborate with hardware, software, and systems engineers to bridge communication gaps and ensure seamless hardware-software integration.

Skills

C++

System design

Kernel drivers

RDMA

HPC

Storage systems

Leadership

Education

Bachelor's degree

Master's or PhD preferred

Tools

C

ML infrastructure

Job description

Google Sunnyvale is seeking a Senior Staff Software Engineer to lead the evolution of the HPN stack and drive integration with high-performance storage and AI infrastructure. You will shape the efficiency, scalability, and performance of Google’s hyperscaler platform for AI/ML workloads.

You will mentor distributed teams, design scalable architectures, and partner across RDMA, storage, and AI/ML to deliver cutting-edge capabilities for Google Cloud and users worldwide.