Senior AI Infra Engineer: Scalable Training & Serving

LinkedIn; California (MO); Hybrid; USD 139,000 - 229,000; Full time

Job summary

LinkedIn is seeking a Sr. Software Engineer to join the AI Training Infra team.

You will help build next‑gen training and serving infrastructure for large-scale models and feature engineering across billions of parameters, collaborating with researchers and engineers. This role emphasizes high performance data I/O, containerized pipelines, GPU-accelerated inference, and close work with open‑source communities (HuggingFace, PyTorch, DeepSpeed).

Qualifications

• Bachelor's Degree in Computer Science or related technical discipline, or equivalent practical experience
• 2+ years of experience in the industry with leading/ building deep learning systems.
• 2+ years of experience with Java, C++, Python, Go, Rust, C# and/or Functional languages such as Scala or other relevant coding languages
• Hands-on experience developing distributed systems or other large-scale systems.

Responsibilities

• Owning the technical strategy for broad or complex requirements with insightful and forward-looking approaches that go beyond the direct team and solve large open-ended problems.
• Designing, implementing, and optimizing the performance of large-scale distributed serving or training for personalized recommendation as well as large language models.
• Improving the observability and understandability of various systems with a focus on improving developer productivity and system sustenance.
• Mentoring other engineers, defining our challenging technical culture, and helping to build a fast-growing team.
• Working closely with the open-source community to participate and influence cutting-edge open-source projects (e.g., vLLMs, PyTorch, GNNs, DeepSpeed, Huggingface, etc.).
• Functioning as the tech-lead for several concurrent key initiatives AI Infrastructure and defining the future of AI Platforms.

Skills

Java

C++

Python

Go

Rust

C#

Scala

Education

Bachelor's Degree in Computer Science or related technical discipline

Tools

Huggingface

Horovod

PyTorch

TensorFlow

DeepSpeed

GNNs

Kubeflow

MLFlow

Job description

LinkedIn is seeking a Sr. Software Engineer to join the AI Training Infra team.

You will help build next‑gen training and serving infrastructure for large-scale models and feature engineering across billions of parameters, collaborating with researchers and engineers. This role emphasizes high performance data I/O, containerized pipelines, GPU-accelerated inference, and close work with open‑source communities (HuggingFace, PyTorch, DeepSpeed).