Senior AI Observability Engineer – Platform & Scalable ML

Netflix; Los Gatos (CA); On-site; USD 388,000 - 619,000; Full time

Benefits offered by this job

Health plans

Mental health support

401(k) with employer match

Stock options

Disability programs

Flexible Spending Accounts

Paid time off

Job summary

Netflix is seeking a hands-on senior engineer to build the observability framework for AI/ML systems. You will design reusable infrastructure that enables ML/AI practitioners across domains to monitor model quality in production, evaluate LLM and agentic systems, and adopt vendor tooling through a consistent, self-serve platform.

You will partner with engineering, product, machine learning and data teams to translate their needs into platform capabilities, own SDKs and APIs, and champion

Qualifications

• Proven track record designing standards, libraries, SDKs, or frameworks used by multiple teams.
• Hands-on production observability or ML/LLM evaluation experience.
• Strong coding skills in Python and at least one of Java, Go, or Scala.
• Experience operating ML models in production (online or batch).

Responsibilities

• Build the observability framework and platform capabilities for ML/GenAI systems.
• Develop primitives to monitor model performance, data quality, drift, and degradation.
• Extend evaluation frameworks for LLM/agentic systems with robust scoring.
• Lead build-vs-buy evaluations for observability tooling and own SDKs/APIs.
• Create reusable libraries and templates to promote observability-by-default.

Skills

Python

Java/Go/Scala

Production services

Observability

Cross-functional collaboration

Vendor integration

Tools

Prometheus/Grafana

Datadog

OpenTelemetry

ELK/OpenSearch

Jaeger/Tempo

Job description

Netflix is seeking a hands-on senior engineer to build the observability framework for AI/ML systems. You will design reusable infrastructure that enables ML/AI practitioners across domains to monitor model quality in production, evaluate LLM and agentic systems, and adopt vendor tooling through a consistent, self-serve platform.

You will partner with engineering, product, machine learning and data teams to translate their needs into platform capabilities, own SDKs and APIs, and champion