Senior AI Infra & ML Platform Architect

LinkedIn; Sunnyvale (CA); Hybrid; USD 198,000 - 326,000; Full time

Job summary

LinkedIn is building the next generation of ML infrastructure. The Senior Staff Software Engineer, AI Infrastructure, will define architecture for large-scale Model Evaluation and Observability systems, spanning multiple product lines and AI use cases.

You will lead distributed platform design and drive reliability across teams. You will mentor engineers, shape engineering practices, and work with ML researchers to ensure scalable, trustworthy AI systems at LinkedIn.

Qualifications

• BS/BA in Computer Science or related technical field or equivalent experience.
• 5+ years of software design, development, and algorithm-related solutions.
• 5+ years programming in Python, C++, Java, Go, Rust, or Scala.
• 2+ years in architecture, technical lead, or equivalent leadership.
• 5+ years building large-scale infrastructure, ML systems, or distributed systems.
• Hands-on experience designing distributed systems or large-scale production platforms.

Responsibilities

• Own technical strategy and architecture for large-scale Model Evaluation and Observability.
• Design highly available, distributed architectures to ingest and analyze high-volume telemetry.
• Build scalable model evaluation platforms to measure quality and compare models.
• Lead diagnosis and resolution of cross-team performance bottlenecks and data quality issues.
• Define observability-by-default frameworks to speed experimentation and production reliability.
• Identify issues such as model drift, training-serving skew, and data-quality problems.
• Mentor engineers, raise the technical bar, and drive architecture across teams.
• Serve as a technical leader across multiple initiatives and scale for future data growth.
• Anticipate future scale and evolving governance standards.

Skills

Python

C++

Java

Go

Rust

Scala

Model Observability

MLOps

Education

BS/BA in Computer Science or related field

MS or PhD in CS or related discipline

Tools

OpenTelemetry (OTEL)

Job description

LinkedIn is building the next generation of ML infrastructure. The Senior Staff Software Engineer, AI Infrastructure, will define architecture for large-scale Model Evaluation and Observability systems, spanning multiple product lines and AI use cases.

You will lead distributed platform design and drive reliability across teams. You will mentor engineers, shape engineering practices, and work with ML researchers to ensure scalable, trustworthy AI systems at LinkedIn.