Senior AI Infrastructure Architect — Scalable Inference

NetApp; San Jose (CA); Hybrid; USD 266,000 - 396,000; Full time

Benefits offered by this job

Health Insurance

Life Insurance

Retirement Plans

Paid Time Off

Performance-Based Incentives

Employee Stock Purchase Plan

RSUs

Job summary

NetApp in California is seeking a Distinguished Engineer to lead AI infrastructure and large-scale inference. You will architect and ship an enterprise-grade AI platform serving millions of requests with ultra-low latency and high throughput.

You set the technical North Star, drive roadmaps, and influence product and engineering teams. You will mentor engineers, push for GPU/TPU orchestration, secure multi-tenant solutions, and define state-of-the-art AI workflows.

Qualifications

• Deep hands-on experience with high-performance inference engines (TensorRT, vLLM, ONNX Runtime, Triton).
• 15+ years architecting fault-tolerant, low-latency distributed systems.
• Built enterprise-grade AI platforms with model registries, feature stores, and multi-tenant serving.
• Experience with GPU/TPU cluster orchestration and memory hierarchy optimization.

Responsibilities

• Define the technology strategy to accelerate innovation at NetApp.
• Define long-term roadmap derived from business priorities and trends.
• Partner with Product and Eng to deliver next-generation AI products.
• Influence execs and engineers to elevate the portfolio and architecture.
• Mentor senior/principal engineers and set technical standards.

Skills

AI/ML inference

Distributed systems

RAG pipelines

Model optimization

GPU/TPU orchestration

Security & multi-tenancy

Kubernetes scheduling

Low-latency design

High-performance networking

Tools

TensorRT

vLLM

ONNX Runtime

Triton

Job description

NetApp in California is seeking a Distinguished Engineer to lead AI infrastructure and large-scale inference. You will architect and ship an enterprise-grade AI platform serving millions of requests with ultra-low latency and high throughput.

You set the technical North Star, drive roadmaps, and influence product and engineering teams. You will mentor engineers, push for GPU/TPU orchestration, secure multi-tenant solutions, and define state-of-the-art AI workflows.