Senior Staff AI Infrastructure Engineer — Scale Billion-Parameter Models

Linkedin3

Sunnyvale (CA)

Hybrid

USD 260,000 - 360,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

LinkedIn in Mountain View, CA or Bellevue, WA is hiring a Sr. Staff Software Engineer to scale AI training infrastructure and serving for recommendations, LLMs, and computer vision models. The role is hybrid, with work from home and select office days.

You will own technical strategy, design high-performance distributed systems, improve observability, mentor engineers, and collaborate with open-source communities to advance AI platforms.

Qualifications

  • BS/BA in Computer Science or related field or equivalent experience.
  • 5+ years in software design, development, and algorithms.
  • 5+ years of experience in OO languages such as Python, C++, Java, Go, Rust, Scala.
  • 2+ years as an architect or technical leader.
  • 5+ years of experience in building deep learning systems.
  • Hands-on experience building distributed or large-scale systems.

Responsibilities

  • Own the technical strategy for broad or complex requirements that solve large open-ended problems.
  • Design, implement, and optimize the performance of large-scale distributed serving or training for recommendations and large language models.
  • Improve observability and understandability of systems to boost developer productivity.
  • Mentor engineers, shape our technical culture, and help grow the team.
  • Collaborate with the open-source community on projects (e.g., vLLMs, PyTorch, GNNs, DeepSpeed, Huggingface).
  • Serve as tech-lead for multiple AI infrastructure initiatives and define the future of AI platforms.

Skills

Python
C++
Java
Go
Rust
Scala

Education

BS/BA in Computer Science
MS or PhD in Computer Science

Tools

TensorFlow
PyTorch
Horovod
Huggingface
DeepSpeed
GNNs
PyTorch Lightning
CUDA

Job description

LinkedIn in Mountain View, CA or Bellevue, WA is hiring a Sr. Staff Software Engineer to scale AI training infrastructure and serving for recommendations, LLMs, and computer vision models. The role is hybrid, with work from home and select office days.

You will own technical strategy, design high-performance distributed systems, improve observability, mentor engineers, and collaborate with open-source communities to advance AI platforms.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff AI Platform Engineer — Scalable ML Infra (Hybrid)
Staff AI Platform Engineer — Scalable ML Infra (Hybrid)

Linkedin3 • Mountain View (CA)

Hybrid
USD 210,000 - 270,000
Staff ML Engineer — Scalable Recommendations & AI Platform
Staff ML Engineer — Scalable Recommendations & AI Platform

NewsBreak • Mountain View (CA)

On-site
USD 230,000 - 300,000
Health, dental, and vision care
Top-tier 401(K) plan with company-mact
Paid time off and paid holidays
+3
Staff Software Engineer - AI Platform
Staff Software Engineer - AI Platform

Linkedin3 • Mountain View (CA)

Hybrid
USD 210,000 - 270,000
Senior AI Systems Engineer — Recommender at Scale
Senior AI Systems Engineer — Recommender at Scale

Aimlroles • Mountain View (CA)

Hybrid
USD 175,000 - 287,000
Sr. Staff Software Engineer, AI Infrastructure
Sr. Staff Software Engineer, AI Infrastructure

Linkedin3 • Sunnyvale (CA)

Hybrid
USD 260,000 - 360,000
Remote Senior ML Platform Engineer — Scale AI Infrastructure
Remote Senior ML Platform Engineer — Scale AI Infrastructure

CoinBucha • California

Remote
USD 217,000 - 326,000
Remote work
Medical insurance
Flexible time off
+2
Senior AI Training Infrastructure Engineer | Bellevue (Hybrid)
Senior AI Training Infrastructure Engineer | Bellevue (Hybrid)

Designworks Talent • Bellevue (WA)

Hybrid
USD 150,000 - 210,000
Medical, dental, and vision insurance
401(k) plan with company match
Paid holidays
Senior ML Engineer — AI & Large-Scale Recommendations
Senior ML Engineer — AI & Large-Scale Recommendations

NewsBreak • Mountain View (CA)

On-site
USD 195,000 - 230,000
Health, dental, and vision coverage
Top-tier 401(K) with company matching
Paid time off & holidays
+2
Senior ML Platform Engineer — AI Infra
Senior ML Platform Engineer — AI Infra

Robinhood • Bellevue (CA)

On-site
USD 209,000 - 245,000
Health insurance
Equity ownership
401k matching
+2
Senior Staff ML Infra Engineer for Scalable AI
Senior Staff ML Infra Engineer for Scalable AI

Pinterest, Inc. • San Francisco (CA)

Hybrid
USD 245,000 - 429,000
Equity