Principal AI Infrastructure Engineer, GenAI Platform

Netflix

United States

On-site

USD 180,000 - 270,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Netflix is rebuilding its AI/ML model serving platform to support real-time, asynchronous, and agentic workloads at global scale. You will lead the architecture and implementation of distributed systems that couple in-house inference with third-party hosting, focusing on latency, throughput and cost efficiency.

You will drive deployment strategies across GPUs, CPUs and multiple model providers, delivering durable, resumable execution for long-running tasks and near-real-time inference.

Qualifications

  • Have 12+ years of experience in AI/ML infrastructure and distributed systems.
  • Ability to guide architectural decisions across multiple teams through data and expertise.
  • Shape long-term technical roadmaps (2–3 years ahead) with a focus on scalability and cost efficiency.
  • Partner with product managers, operations, and executives to balance technical trade-offs with business priorities.
  • Translate dense technical concepts for non-technical stakeholders and produce clear ADRs and proposals.
  • Experience with high-traffic distributed services and infrastructure for AI/ML model inference, with emphasis on availability, security and performance.
  • Experience building scalable model-serving solutions for foundation models powering AI applications; reduce latency and costs.

Responsibilities

  • Lead the technology behind Netflix's GenAI and Foundation Model serving strategy.
  • Architect systems that run at scale and with reliability for real-time and asynchronous workloads.
  • Embed AI capabilities into member-facing products and ensure secure, high-performance execution.
  • Collaborate with teams to optimize routing, decoupled serving, and multi-GPU inference.

Skills

Distributed systems
High-availability
GPU/CPU inference optimization
Kubernetes
Cloud platforms (AWS/Azure/GCP)
Architectural decision making
ADR documentation

Education

BS/MS/PhD in Computer Science, Applied Math, Engineering, or related field

Tools

NVIDIA Triton Inference Server
vLLM
SGLang
Kubernetes
AWS/Azure/GCP
NVIDIA CUDA programming

Job description

Netflix is rebuilding its AI/ML model serving platform to support real-time, asynchronous, and agentic workloads at global scale. You will lead the architecture and implementation of distributed systems that couple in-house inference with third-party hosting, focusing on latency, throughput and cost efficiency.

You will drive deployment strategies across GPUs, CPUs and multiple model providers, delivering durable, resumable execution for long-running tasks and near-real-time inference.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Platform Engineering Manager: Online Serving & Inference
AI Platform Engineering Manager: Online Serving & Inference

pofft Technology Inc. • United States

On-site
USD 523,000 - 920,000
Staff/ Principal Software Engineer (L6/L7): AI Platform Model Serving
Staff/ Principal Software Engineer (L6/L7): AI Platform Model Serving

Netflix • United States

On-site
USD 180,000 - 270,000
Engineering Manager, Online Serving and Inference, AI Platform
Engineering Manager, Online Serving and Inference, AI Platform

pofft Technology Inc. • United States

On-site
USD 523,000 - 920,000
GenAI Platform Engineer – Ads Foundations
GenAI Platform Engineer – Ads Foundations

Netflix • New York (NY)

On-site
USD 388,000 - 558,000
Health plans
Mental health support
401(k) with employer match
+5
Engineering Manager, ML Platform & Inference
Engineering Manager, ML Platform & Inference

Netflix • Sacramento (CA)

Remote
USD 58,000 - 70,000
Principal AI Infrastructure Engineer
Principal AI Infrastructure Engineer

gatikaiinc • Mountain View (CA)

On-site
USD 180,000 - 260,000
Senior Research Engineer, GenAI Messaging & Personalization
Senior Research Engineer, GenAI Messaging & Personalization

Netflix • Los Gatos (CA)

On-site
USD 180,000 - 280,000
Health plans
401(k) with employer match
Stock option program
+5
Senior Manager, GenAI Strategy & Analytics
Senior Manager, GenAI Strategy & Analytics

Netflix • Los Gatos (CA)

On-site
USD 350,000 - 560,000
Health plans
Mental health support
401(k) with employer match
+5
Staff AI Product Lead - Agentic Systems for Games
Staff AI Product Lead - Agentic Systems for Games

Netflix • Los Gatos (CA)

On-site
USD 890,000 - 1,690,000
Health plans
Stock options
401(k) matching
+2
Tech Lead, GenAI & Agentic Systems — Games
Tech Lead, GenAI & Agentic Systems — Games

Netflix • Los Gatos (CA)

Remote
USD 650,000 - 1,100,000
Health plans
Mental health support
401(k) with employer match
+3