Staff Software Engineer, On-Prem AI Compute & Infra

Google LLC; Kirkland (WA); On-site; USD 207,000 - 300,000; Full time

Benefits offered by this job

Health, dental, vision, life, <br>dis"

401(k) with company match

Paid Time Off: 20 days/year

Sick Time: 40 hours/year (Seattle 69)

Maternity Leave: 28-30 weeks

Baby Bonding Leave: 18 weeks

Holidays: 13 paid days

Job summary

Google LLC is seeking a Staff Software Engineer for Cloud ML Compute Services in Kirkland, WA. This role focuses on building next-generation on-premise AI infrastructure to optimize training and inference workloads across Google's global fleet.

You will lead a team, shape the technical roadmap, collaborate across hardware and software, and mentor engineers while delivering reliable, scalable systems with strong SLOs and telemetry.

Qualifications

• 8 years of experience programming in C++.
• 5 years testing and launching software products.
• 5 years building large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage, or hardware architecture.
• 3 years of experience with software design and architecture.

Responsibilities

• Set the strategic direction and technical roadmap to build scalable, next-generation on-premise AI infrastructure and compute services.
• Guide the design and development of complex cloud and systems-level infrastructure, spanning the hardware and software stack, including low-level software, OS, firmware, and networking.
• Act as a technical leader within a newly formed team to mentor and grow software engineers, scoping bold problems into tractable projects.
• Define and implement clear success metrics, SLIs/SLOs, telemetry, and logs for production operations and continuous improvement.
• Take central ownership of system troubleshooting and diagnostics, leading automated repair systems for the global fleet.

Skills

C++

Distributed systems

Software testing

Architecture design

Education

Bachelor's degree or equivalent

Job description

Google LLC is seeking a Staff Software Engineer for Cloud ML Compute Services in Kirkland, WA. This role focuses on building next-generation on-premise AI infrastructure to optimize training and inference workloads across Google's global fleet.

You will lead a team, shape the technical roadmap, collaborate across hardware and software, and mentor engineers while delivering reliable, scalable systems with strong SLOs and telemetry.