Senior AI/HPC Infrastructure Engineer

Sandisk; Milpitas (CA); Presencial; USD 140.000 - 210.000; Jornada completa

Descripción de la vacante

Sandisk is seeking an AI/HPC Infrastructure Engineer to design and operate advanced GPU-based AI platforms for training, inference, and memory-system research. You will work at the intersection of AI infrastructure, LLM serving, memory architecture, storage systems, and workload characterization to drive next-generation memory products.

The role involves building scalable AI testbeds, deploying LLM serving stacks, and performing detailed workload analyses to optimize performance and cost across

Formación

• Linux, Kubernetes, Docker, Slurm, Python, GPU cluster administration.
• Distributed systems engineering and AI infrastructure expertise.
• Experience with vLLM, NVIDIA Dynamo, TensorRT-LLM, Triton, SGLang and RAG systems.

Responsabilidades

• Build AI testbeds supporting 8-100+ GPU environments.
• Manage server, networking, storage, and software infrastructure.
• Support cloud-scale and edge-AI deployment models.
• Develop benchmarking and validation environments for AI workloads.
• Install and optimize vLLM, NVIDIA Dynamo, TensorRT-LLM, Triton, SGLang.
• Support distributed inference and agentic AI workloads.
• Optimize latency, throughput, and GPU utilization.
• Evaluate inference cost and scalability across architectures.
• Capture workload traces and analyze memory bandwidth, KV-cache growth, storage access patterns, network traffic.
• Develop forecasting models for future memory like HBF and storage requirements.
• Generate insights to guide memory product development.
• Prototype memory-system architectures; study disaggregated memory/storage; validate AI infrastructure benefits of Sandisk tech.
• Build simulation and digital-twin platforms; model future configurations.
• Collaborate with universities, startups, labs, cloud providers, OEMs; publish papers.

Conocimientos

Linux

Kubernetes

Docker

Slurm

Python

GPU cluster administration

Distributed systems engineering

vLLM

NVIDIA Dynamo

TensorRT-LLM

Triton

SGLang

Agentic AI frameworks

RAG systems

InfiniBand

RoCE

RDMA

NCCL

Multi-node inference

Distributed AI clusters

AI accelerator architecture

Memory hierarchy optimization

SSD architecture

Storage-memory co-design

AI performance modeling

Hardware/software co-design

Herramientas

vLLM

NVIDIA Dynamo

TensorRT-LLM

Triton

SGLang

Descripción del empleo

Sandisk is seeking an AI/HPC Infrastructure Engineer to design and operate advanced GPU-based AI platforms for training, inference, and memory-system research. You will work at the intersection of AI infrastructure, LLM serving, memory architecture, storage systems, and workload characterization to drive next-generation memory products.

The role involves building scalable AI testbeds, deploying LLM serving stacks, and performing detailed workload analyses to optimize performance and cost across