Senior Staff SWE – High-Performance Networking

Google LLC; New York (NY); On-site; USD 262,000 - 364,000; Full time

Job summary

Google is seeking a Senior Staff Software Engineer in New York to advance high-performance networking within the Platforms Infrastructure Engineering group. You will lead a distributed team, architect scalable software for large-scale AI/ML workloads, and drive RDMA-enabled storage and HPC integration across multiple teams.

The role emphasizes technical leadership, system design, and collaboration across cross-functional groups, with opportunities to influence the future of Google's hyperscale

Qualifications

• Bachelor's degree or equivalent practical experience.
• 8 years of experience programming in C++.
• 5 years of design, architecture, testing and launching software.
• Experience with C, High Performance Computing, Remote Direct Memory Access, Storage Systems, System Design, and Kernel Drivers.

Responsibilities

• Technical Leadership and Mentorship: Lead and coach a distributed engineering team, fostering innovation while aligning cross-functional groups on goals, priorities, and deliverables.
• Large-Scale and LLM Architecture: Design and deploy scalable software and advanced serving architectures, optimizing the LLM serving stack for efficiency and reliability.
• Performance and Network Engineering: Architect performant network transport across various NICs and platforms, tuning the communication stack to accelerate HPC, RDMA, and ML workloads.
• Strategic Roadmap and Trends: Partner with cross-organizational leaders to co-develop roadmaps bridging RDMA, storage, and AI/ML, staying ahead of training and inference advancements.
• Collaborative System Integration: Collaborate with hardware, software, and systems engineers to bridge communication gaps and ensure seamless hardware-software integration.

Skills

C++ programming

C

HPC

RDMA

Storage systems

System design

Kernel drivers

Leadership

Education

Bachelor's degree or equivalent

Master's degree or PhD (preferred)

Job description

Google is seeking a Senior Staff Software Engineer in New York to advance high-performance networking within the Platforms Infrastructure Engineering group. You will lead a distributed team, architect scalable software for large-scale AI/ML workloads, and drive RDMA-enabled storage and HPC integration across multiple teams.

The role emphasizes technical leadership, system design, and collaboration across cross-functional groups, with opportunities to influence the future of Google's hyperscale