Senior AI Infra Engineer - SRE for Inference (Equity)

engineeringjobs.net, Inc.

Sunnyvale (CA)

On-site

USD 200,000 - 280,000

Full time

7 days ago
Be an early applicant
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

Bonus
Equity
Benefits

Job summary

engineeringjobs.net, Inc. seeks an experienced software architect to own the architecture and design of scalable AI inference and training infrastructure.

You will partner with development teams and tech leads to deliver cost-effective, high-performance systems for production use. You will lead incident response and blameless postmortems, promote AI-first development, and collaborate with SRE leaders across Google to implement scalable solutions.

Qualifications

  • Requires a bachelor's degree in computer science, a related field, or equivalent practical experience; at least eight years of software development experience; four years leading projects and providing technical leadership; and three years designing, analyzing, and troubleshooting distributed systems. Experience with machine learning or AI in a software development environment is required, while a master's degree in computer science or engineering is preferred.

Responsibilities

  • Own the architecture and design of reliable, scalable, cost-effective, and performant AI inference and training infrastructure, partnering with development teams and technical leads.
  • Lead production incident response and blameless postmortems, promote AI-first development, and collaborate with SRE leaders across Google to share scalable solutions.

Skills

Software Development
Technical Leadership
Distributed Systems
Machine Learning
Artificial Intelligence
Site Reliability Engineering
AI Infrastructure
Inference Infrastructure
Training Infrastructure
System Architecture
Large-Scale System Design
Incident Response
Blameless Postmortems
Automation
Scalability
Performance Optimization

Education

Bachelor's degree in computer science, related field, or equivalent practical experience
Master's degree in computer science or engineering preferred

Job description

engineeringjobs.net, Inc. seeks an experienced software architect to own the architecture and design of scalable AI inference and training infrastructure.

You will partner with development teams and tech leads to deliver cost-effective, high-performance systems for production use. You will lead incident response and blameless postmortems, promote AI-first development, and collaborate with SRE leaders across Google to implement scalable solutions.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Staff Software Engineer, Site Reliability Engineering, Workspace AI
Senior Staff Software Engineer, Site Reliability Engineering, Workspace AI

engineeringjobs.net, Inc. • Sunnyvale (CA)

On-site
USD 200,000 - 280,000
Bonus
Equity
Benefits
AI Infrastructure SRE Manager – Scale & Reliability
AI Infrastructure SRE Manager – Scale & Reliability

Google • San Jose (CA)

On-site
USD 207,000 - 300,000
Staff Software Engineer - Lead Large-Scale AI Infra
Staff Software Engineer - Lead Large-Scale AI Infra

Google • Sunnyvale (CA)

On-site
USD 207,000 - 300,000
Health insurance
Dental insurance
Vision insurance
+8
AI-First Infra Engineer with Equity Options
AI-First Infra Engineer with Equity Options

Google Inc. • Sunnyvale (CA)

On-site
USD 174,000 - 252,000
Equity compensation
Benefits package
Bonus target (15%)
AI/ML Training Infra Lead — Scale & Reliability
AI/ML Training Infra Lead — Scale & Reliability

Google • Sunnyvale (CA)

On-site
USD 215,000 - 292,000
Senior AI Inference Systems Engineer (Equity)
Senior AI Inference Systems Engineer (Equity)

Emploive • San Francisco (CA)

On-site
USD 230,000 - 390,000
Flexible PTO
Medical, dental, vision benefits
Retirement plan
+3
Senior AI & Infrastructure Systems Engineer
Senior AI & Infrastructure Systems Engineer

Google LLC • Sunnyvale (CA), Northern (KY)

Hybrid
USD 174,000 - 252,000
Health insurance
Dental insurance
Vision insurance
+8
Senior AI Inference Infrastructure Engineer
Senior AI Inference Infrastructure Engineer

Modular • United States

Hybrid
USD 167,000 - 273,000
Competitive salary
Premier insurance plans
Flexible paid time off
+1
Senior SRE: AI Infra Architect for Workspace AI
Senior SRE: AI Infra Architect for Workspace AI

Google LLC • Sunnyvale (CA)

On-site
USD 262,000 - 364,000
Software Engineering Manager II, Site Reliability Engineering, Data Intelligence
Software Engineering Manager II, Site Reliability Engineering, Data Intelligence

Google • San Jose (CA)

On-site
USD 207,000 - 300,000