Staff AI/ML Infra Engineer - GenAI & Scale

Google LLC; Pittsburgh (Allegheny County); On-site; USD 207,000 - 300,000; Full time

Benefits offered by this job

Equity

Bonus program

Comprehensive benefits

Job summary

Google LLC in the United States is seeking a software engineer to advance ML infrastructure and large‑scale systems that power billions of users. You will influence model deployment, data processing, and AI research collaboration across Google Research and DeepMind.

You will manage priorities, design, test, and deploy software solutions, with opportunities to switch teams as the AI platform grows. Expect collaboration across multi‑functional teams and a focus on scalable engineering.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 8 years of experience programming in Python or C++.
• 5 years of experience testing, and launching software products.
• 5 years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
• 3 years of experience with software design and architecture.
• 2 years of experience with GenAI techniques or related concepts.
• Master’s degree or PhD in Engineering, Computer Science, or related technical field.
• 8 years of experience with data structures and algorithms.
• 3 years of experience working in a complex, matrixed organization involving cross‑functional or cross‑business projects.
• 3 years of experience in a technical leadership role leading project teams and setting technical direction.

Responsibilities

• Work across many different aspects of machine learning infrastructure and modeling.
• Change infrastructure (training and serving) to support new modeling techniques and products.
• Prototype new infrastructure, automation, workflows, and tooling. Analyze and debug performance, and make improvements.
• Improve robustness, reliability, and usability of infrastructure. Collaborate closely with other members of our team and partners to build systems that take advantage of and integrate seamlessly across our ecosystem.
• Engage with modeling teams to explore pain points and novel use cases. Research emerging technology and make trade‑off decisions on immediate wins vs longer‑term stability.

Skills

Python

C++

ML design

Model deployment

Data processing

Debugging

Fine tuning

Software design

GenAI

Education

Bachelor’s degree

Master’s degree or PhD

Job description

Google LLC in the United States is seeking a software engineer to advance ML infrastructure and large‑scale systems that power billions of users. You will influence model deployment, data processing, and AI research collaboration across Google Research and DeepMind.

You will manage priorities, design, test, and deploy software solutions, with opportunities to switch teams as the AI platform grows. Expect collaboration across multi‑functional teams and a focus on scalable engineering.