Senior AI Observability Platform Engineer

Netflix, Inc.; United States; On-site; USD 388,000 - 619,000; Full time

Benefits offered by this job

Health plans

Mental health support

401(k) with employer match

Stock options

Disability programs

Health savings account

Family-forming benefits

Job summary

Netflix, Inc. is seeking a hands-on Senior Engineer to build the frameworks behind the AI Observability platform, focusing on model performance, evaluation, and vendor integration.

You will design reusable infrastructure that empowers ML/AI practitioners across domains to monitor production systems and maintain reliability. You will collaborate with engineering, data, infra, and product teams to turn needs into reusable platform capabilities, ensuring scalable and robust solutions.

Qualifications

• Experience in software, AI/ML, or platform engineering with hands-on production observability.
• Proven track record designing standards, libraries, SDKs, or frameworks used by multiple teams.
• Strong coding skills in Python and at least one of Java, Go, or Scala with production services experience.
• Hands-on experience operating ML models in production (online or batch) including data quality and drift.

Responsibilities

• Build the observability framework and platform capabilities for ML/GenAI systems, including metrics, logs, and traces across inference and batch processing.
• Develop primitives to monitor model performance, data quality, drift, and degradation across systems.
• Extend evaluation frameworks for LLM and agentic systems, including prompt logging and human-in-the-loop scoring.
• Lead build-vs-buy evaluations for observability and eval tooling and own SDKs, connectors, APIs for vendor platforms.
• Create reusable libraries and templates to accelerate observability by default across new systems.
• Provide dashboards, alerts, and SLO/SLI templates to track performance, latency, cost, and reliability.

Skills

Python

Java/Go/Scala

Distributed systems

Observability

Cloud platforms

ML/LLM evaluation

Tools

Prometheus/Grafana

Datadog

OpenTelemetry

ELK/OpenSearch

Jaeger

Job description

Netflix, Inc. is seeking a hands-on Senior Engineer to build the frameworks behind the AI Observability platform, focusing on model performance, evaluation, and vendor integration.

You will design reusable infrastructure that empowers ML/AI practitioners across domains to monitor production systems and maintain reliability. You will collaborate with engineering, data, infra, and product teams to turn needs into reusable platform capabilities, ensuring scalable and robust solutions.