Senior AI Observability Platform Engineer

Netflix; Los Gatos (CA); On-site; USD 388,000 - 619,000; Full time

Benefits offered by this job

Health Plans

Mental Health support

401(k) Retirement Plan with employer 


Stock Option Program

Disability Programs

Health Savings and Flexible Spending

Family-forming benefits

Life and Serious Injury Benefits

Paid time off

Flexible time off

Job summary

Netflix is seeking a senior AI Observability Platform Engineer to build end-to-end observability for ML and GenAI workloads across online and batch systems. You will own SDKs, tooling, and dashboards to instrument, monitor, and evaluate models with a focus on reliability and explainability.

The role requires hands-on coding in Python and one of Java/Go/Scala, plus experience with modern observability stacks and cloud platforms.

Qualifications

• Experience in software, AI/ML, or platform engineering with production observability
• Proven ability to design standards, libraries, SDKs, or frameworks
• Strong coding skills in Python and at least one of Java, Go, or Scala
• Experience operating ML models in production (online or batch)
• Familiarity with modern observability stacks (Prometheus/Grafana, Datadog, OpenTelemetry, ELK/OpenSearch, Jaeger)
• Knowledge of distributed systems and at least one major cloud platform (AWS, GCP, Azure)
• Ability to collaborate across ML, data, infra, and product teams
• Experience with vendor integration and VPC deployment
• AI-Native engineering mindset to accelerate design and testing

Responsibilities

• Build the observability framework and platform capabilities for ML/GenAI systems across online inference and batch scoring
• Monitor model performance, data quality, drift, and degradation in production
• Develop evaluation frameworks for LLM and agentic systems and support reusable eval building blocks
• Lead build-vs-buy evaluations for observability and eval tools; own SDKs, connectors, and APIs
• Create reusable libraries, SDKs, and templates to enable observability by default
• Provide dashboards, alerts, and SLO/SLI templates to track performance, latency, cost, and reliability

Skills

Python programming

Java

Go

Scala

production observability

ML/LLM evaluation

cross-functional collaboration

Tools

Prometheus/Grafana

Datadog

OpenTelemetry

ELK/OpenSearch

Jaeger/Tempo

Job description

Netflix is seeking a senior AI Observability Platform Engineer to build end-to-end observability for ML and GenAI workloads across online and batch systems. You will own SDKs, tooling, and dashboards to instrument, monitor, and evaluate models with a focus on reliability and explainability.

The role requires hands-on coding in Python and one of Java/Go/Scala, plus experience with modern observability stacks and cloud platforms.