Staff Engineer, AI Evaluation Infrastructure

LinkedIn; Mountain View (CA); Hybrid; USD 175,000 - 287,000; Full time

Job summary

LinkedIn is seeking a Staff Software Engineer to own the EOS platform for evaluating AI agents and GenAI products. The role focuses on distributed systems, data infrastructure, and ML, with responsibilities spanning design, implementation, and production reliability.

Mountain View-based hybrid work model is offered to collaborate with AI product teams and infrastructure partners. You will build evaluation systems using LLM-based evaluators, create real-time monitoring, and drive continuous

Qualifications

• Bachelor’s degree in CS or related discipline or equivalent practical experience.
• 4+ years of experience building deep learning systems.
• 4+ years of experience with Java, C++, Python, Go, Rust, C# and/or Scala.
• Hands-on experience developing distributed systems.
• Hands-on experience building or evaluating AI Agents in Production.

Responsibilities

• Own the technical vision, architecture, and execution of EOS across distributed systems and ML components.
• Design and build large-scale evaluation infrastructure for AI agents and GenAI products.
• Develop tracing and observability infrastructure for production AI systems.
• Architect scalable data pipelines for capturing, labeling, and managing AI interactions.
• Lead cross-functional initiatives, influencing strategy across AI Platforms and engineering.
• Mentor engineers and raise the technical bar within the team.

Skills

Java

C++

Python

Go

Rust

C#

Scala

Education

Bachelor’s degree in Computer Science or related field

Tools

PyTorch

TensorFlow

JAX/FLAX

MLFlow

Kubeflow

Spark

Flink

Beam

Job description

LinkedIn is seeking a Staff Software Engineer to own the EOS platform for evaluating AI agents and GenAI products. The role focuses on distributed systems, data infrastructure, and ML, with responsibilities spanning design, implementation, and production reliability.

Mountain View-based hybrid work model is offered to collaborate with AI product teams and infrastructure partners. You will build evaluation systems using LLM-based evaluators, create real-time monitoring, and drive continuous