Principal AI/HPC Software Engineer

Sandisk; Milpitas (CA); On-site; USD 150,000 - 230,000; Full time

Job summary

Sandisk is seeking an AI/HPC Software Engineer to develop system and infrastructure software for next‑generation AI memory systems. The role spans AI infrastructure, memory-centric software architecture, and hardware/software co-design to optimize memory systems and AI workloads.

You will work on AI inference platforms, training environments, and Open-source AI infrastructure, collaborating with architecture teams to validate new memory concepts and ensure energy-efficient computing at scale.

Qualifications

• Proficiency in Python, C, C++ for system and AI software development.
• Experience with operating systems, device drivers, and system software design.
• Knowledge of GPU architectures, CUDA programming, and AI infrastructure frameworks.

Responsibilities

• Develop system software and prototype platforms for AI/ML infrastructure.
• Design software for memory management, cache optimization, and storage-memory integration.
• Collaborate with hardware architects on memory technologies and AI system co-design.

Skills

Python

C

C++

AI infrastructure

Distributed AI

Tools

Ray

Kubernetes

Docker

Slurm

CUDA

NCCL

Multi-GPU programming

RDMA

InfiniBand

Job description

Sandisk understands how people and businesses consume data and we relentlessly innovate to deliver solutions that enable today’s needs and tomorrow’s next big ideas. With a rich history of groundbreaking innovations in Flash and advanced memory technologies, our solutions have become the beating heart of the digital world we’re living in and that we have the power to shape.

Sandisk meets people and businesses at the intersection of their aspirations and the moment, enabling them to keep moving and pushing possibility forward. We do this through the balance of our powerhouse manufacturing capabilities and our industry-leading portfolio of products that are recognized globally for innovation, performance and quality.

Sandisk has two facilities recognized by the World Economic Forum as part of the Global Lighthouse Network for advanced 4IR innovations. These facilities were also recognized as Sustainability Lighthouses for breakthroughs in efficient operations. With our global reach, we ensure the global supply chain has access to the Flash memory it needs to keep our world moving forward.

Description

Essential Duties and Responsibilities

AI/HPC Software Engineer

Role

The engineer develops system software, infrastructure software, and AI platform technologies for next-generation AI memory systems. The role sits at the intersection of:

• AI infrastructure
• System software
• Memory systems
• AI/HPC platforms
• Hardware/software co-design
• Energy-efficient AI computing

The goal is to demonstrate and optimize future memory-centric architectures that leverage NAND, storage systems, and emerging AI memory technologies.

Core Responsibilities

AI Infrastructure Software Development

Develop System Software And Prototype Platforms For AI/ML Infrastructure

• AI inference platforms
• AI training environments
• Memory-aware computing platforms
• Distributed AI systems
• Open-source AI infrastructure

The role specifically calls out using computer systems and open-source software technologies to demonstrate next-generation memory architectures.

Memory-Centric Software Architecture

Design Software Supporting

• Memory management
• Cache hierarchy optimization
• Data movement protocols
• Storage-memory integration
• AI system runtime environments

The engineer develops software that exposes the advantages of future memory technologies within AI systems.

Hardware/Software Co-Design

Work With Architecture Teams To

• Evaluate new memory technologies
• Prototype future AI systems
• Optimize performance and power efficiency
• Validate next-generation AI memory concepts

The role explicitly requires close collaboration with hardware architects.

Frameworks and APIs

Develop

• Infrastructure software frameworks
• Runtime environments
• APIs
• System software libraries
• Benchmarking and validation tools

for future AI systems.

Required

Programming

• Python
• C
• C++

Systems

• Operating systems
• Device drivers
• System software design
• System programming

AI Computing

• GPU architecture
• CUDA programming
• AI infrastructure
• Computer architecture
• Memory systems

AI Lab Software Engineer

The Strongest Candidate Would Have

AI Serving

• vLLM; TensorRT-LLM; Triton; SGLang; Dynamo

Distributed AI

• Ray; Kubernetes; Docker; Slurm

GPU Systems

• CUDA; NCCL
• Multi-GPU programming

High-Speed Infrastructure

• RDMA; RoCE
• InfiniBand

Memory-System Research

• HBF
• KV-cache hierarchy
• Storage-memory integration
• AI SSD architectures

Research Capabilities

• Workload tracing
• System simulation
• Digital twins
• AI infrastructure modeling

The AI Lab focused on HBF, KV-cache offload, AI SSDs, and memory-system innovation, this software engineer would essentially function as a LLM Infrastructure + AI Systems Research Engineer, rather than a traditional application software developer.

Additional Information

Sandisk is committed to providing equal opportunities to all applicants and employees and will not discriminate based on their race, color, ancestry, religion (including religious dress and grooming standards), sex (including pregnancy, childbirth or related medical conditions, breastfeeding or related medical conditions), gender (including a person’s gender identity, gender expression, and gender-related appearance and behavior, whether or not stereotypically associated with the person’s assigned sex at birth), age, national origin, sexual orientation, medical condition, marital status (including domestic partnership status), physical disability, mental disability, medical condition, genetic information, protected medical and family care leave, Civil Air Patrol status, military and veteran status, or other legally protected characteristics. We also prohibit harassment of any individual on any of the characteristics listed above. Our non-discrimination policy applies to all aspects of employment. We comply with the laws and regulations set forth in the Equal Employment Opportunity is the Law poster.

Sandisk thrives on the power and potential of diversity. As a global company, we believe the most effective way to embrace the diversity of our customers and communities is to mirror it from within. We believe the fusion of various perspectives results in the best outcomes for our employees, our company, our customers, and the world around us. We are committed to an inclusive environment where every individual can thrive through a sense of belonging, respect and contribution.

Sandisk is committed to offering opportunities to applicants with disabilities and ensuring all candidates can successfully navigate our careers website and our hiring process. Please contact us at [e-mail] to advise us of your accommodation request. In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying.