Senior AI Infrastructure Architect — Scale LLMs & GPU Infra

LinkedIn; Sunnyvale (CA); Hybrid; USD 198,000 - 326,000; Full time

Job summary

LinkedIn is hiring a Sr. Staff Software Engineer for AI Infrastructure to advance scaleable AI model training and serving across fast-moving pipelines. You will help optimize data I/O, enable distributed training on massive parameter models, and partner with open-source communities.

The role emphasizes technical leadership, system observability, and mentoring while allowing hybrid work from Mountain View or Bellevue. Strong deep learning infra background is essential.

Qualifications

• BS/BA in Computer Science or related technical field or equivalent
• 5+ years of industry experience in software design, development, and algorithm related solutions
• 5+ years of experience programming in object-oriented languages such as Python, C++, Java, Go, Rust, Scala
• 2+ years of experience as an architect or technical leader
• 5+ years of experience in industry with leading/building deep learning systems
• Hands-on experience developing distributed systems or other large-scale systems

Responsibilities

• Owning the technical strategy for broad or complex requirements with insightful and forward-looking approaches that go beyond the direct team
• Designing, implementing, and optimizing the performance of large-scale distributed serving or training for personalized recommendation as well as large language models
• Improving the observability and understandability of various systems with a focus on improving developer productivity and system sustenance
• Mentoring other engineers, defining our challenging technical culture, and helping to build a fast-growing team
• Working closely with the open-source community to participate and influence cutting edge open-source projects (e.g., vLLMs, PyTorch, GNNs, DeepSpeed, Huggingface, etc.)
• Functioning as the tech-lead for several concurrent key initiatives AI Infrastructure and defining the future of AI Platforms

Skills

Python

C++

Java

Go

Rust

Scala

Education

MS or PhD in Computer Science or related field

Tools

Huggingface

Horovod

PyTorch

TensorFlow

DeepSpeed

PyTorch Lightning

Job description

LinkedIn is hiring a Sr. Staff Software Engineer for AI Infrastructure to advance scaleable AI model training and serving across fast-moving pipelines. You will help optimize data I/O, enable distributed training on massive parameter models, and partner with open-source communities.

The role emphasizes technical leadership, system observability, and mentoring while allowing hybrid work from Mountain View or Bellevue. Strong deep learning infra background is essential.