Staff Software Engineer, ML Compilers, TPU

Google; New York (NY); On-site; USD 207,000 - 301,000; Full time

Benefits offered by this job

20% bonus target

Equity options

Comprehensive benefits

Job summary

Google is looking for a Staff Software Engineer, ML Compilers, TPU in New York, New York. In this role, you will design, develop, test, deploy, maintain, and enhance the XLA compiler, accelerating machine learning workloads for internal and external customers.

Applicants are required to have a Bachelor's degree and significant experience in programming, testing, and software design. This position offers a competitive salary of $207,000 - $301,000 + bonus and equity options.

Qualifications

• Bachelor's degree or equivalent practical experience.
• 8 years of experience programming in C++ or Python.
• 5 years of experience testing and launching software products.
• 5 years of experience with performance, large-scale systems data analysis, visualization tools, or debugging.
• 3 years of experience with software design and architecture.

Responsibilities

• Contribute to the compiler for a novel processor designed to accelerate machine learning workloads.
• Target and compile high-performance implementations of operations at distributed scale.
• Design and implement new compiler passes that extract more performance from current and next-generation TPUs, directly impacting fleet efficiency.
• Collaborate closely with hardware designers to co-design future processors.
• Research high-level representations to effectively program large-scale, distributed, and heterogeneous systems.

Skills

C++

Python

Large-scale systems data analysis

Testing and launching software products

Software design and architecture

Education

Bachelor's degree or equivalent practical experience

Job description

Staff Software Engineer, ML Compilers, TPU

Google's software engineers develop next-generation technologies that change how billions of users connect, explore, and interact with information. In this role you will design, develop, test, deploy, maintain, and enhance the Accelerated Linear Algebra (XLA) compiler that enables Tensor Processing Units (TPUs) to accelerate machine learning and other scientific computing workloads for both internal and external customers. You will support new workloads, optimize for new models, and work on hardware/software co‑design with accelerator teams.

Minimum qualifications:

• Bachelor's degree or equivalent practical experience.
• 8 years of experience programming in C++ or Python.
• 5 years of experience testing and launching software products.
• 5 years of experience with performance, large-scale systems data analysis, visualization tools, or debugging.
• 3 years of experience with software design and architecture.

Preferred qualifications:

• Experience with state‑of‑the‑art ML compilers and their internals, and writing compiler optimization passes.
• Experience debugging correctness and performance issues at all levels of the ML software stack.
• Familiarity with accelerator hardware architectures such as TPUs or GPUs.

Responsibilities

• Contribute to the compiler for a novel processor designed to accelerate machine learning workloads.
• Target and compile high‑performance implementations of operations at distributed scale.
• Design and implement new compiler passes that extract more performance from current and next‑generation TPUs, directly impacting fleet efficiency.
• Collaborate closely with hardware designers to co‑design future processors.
• Research high‑level representations to effectively program large‑scale, distributed, and heterogeneous systems.

US: $207,000 - $301,000 (USD) + 20% bonus target + equity + benefits.

Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that represents the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity or expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition, or any other basis protected by law.

We welcome applicants who need accommodations. Please let us know if you have a need that requires an accommodation.

Google is a global company and, to facilitate collaboration, English proficiency is a requirement for all roles unless otherwise stated.

Alphabet Inc. is the sole contractual partner regarding equity grants.

Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit, is subject to Google's Applicant and Candidate Privacy Policy.