AI SW Stack Deployment Architect (12+ years)

Sandisk; Bengaluru; On-site; INR 5,000,000 - 6,500,000; Full time

Job summary

Sandisk in Bengaluru, India is seeking an AI Software Architect with 12+ years to lead the application/framework layer and deployment stack for the Next Generation Accelerator AI platform. This role focuses on how models run across vLLM, PyTorch, TensorFlow/XLA to production deployment.

You will own end-to-end deployment workflows, collaborate with compiler/runtime teams, and support customers with scalable AI solutions.

Qualifications

• 10+ years in AI/ML systems or software architecture
• Strong experience with PyTorch / Transformers / LLMs
• Hands-on experience with LLM deployment and scalable inference engine systems (e.g., vLLM, Triton, SGLang)
• Experience building scalable AI platforms (cloud/edge)
• Expertise in system design, APIs, and cross-layer integration

Responsibilities

• Architect integration of vLLM, PyTorch, and TensorFlow, JAX/XLA into Next Generation Accelerator stack
• Own LLM execution behavior (batching, KV cache, streaming inference)
• Design and implement end-to-end deployment workflows (packaging, versioning, reproducibility)
• Work cross-functionally with compiler, runtime, and low-level SW teams
• Support customer workloads, model onboarding, and debugging

Skills

AI/ML systems

Software architecture

PyTorch

Transformers

LLM deployment

Cloud/edge platforms

APIs design

Tools

vLLM

Triton

SGLang

XLA/MLIR

Compiler frameworks

Job description

AI SW Stack Deployment Architect (12+ years)

• Full-time
• Job Type (exemption status): Exempt position - Please see related compensation & benefits details below
• Business Function: Firmware Engineering

Role Overview

We are looking for a Software Architect (12+ years experience) to lead the application/framework layer and deployment stack for the Next Generation Accelerator AI platform. This role owns how models run on Next Generation Accelerator—from vLLM / PyTorch / TensorFlow/XLA to production deployment—ensuring correctness, performance, and scalability.

Key Responsibilities

• Architect integration of vLLM, PyTorch, and TensorFlow, JAX/XLA into Next Generation Accelerator stack
• Own LLM execution behavior (batching, KV cache, streaming inference)
• Design and implement end-to-end deployment workflows (packaging, versioning, reproducibility)
• Work cross-functionally with compiler, runtime, and low-level SW teams
• Support customer workloads, model onboarding, and debugging

Impact

Own customer-visible AI execution and deployment on Next Generation Accelerator, closing the gap between models and system performance, and enabling enterprise-grade AI solutions.

Required Qualifications

• 10+ years in AI/ML systems or software architecture
• Strong experience with PyTorch / Transformers / LLMs
• Hands‑on experience with LLM deployment and scalable inference engine systems (e.g., vLLM, Triton, SGLang)
• Experience building scalable AI platforms (cloud/edge)
• Expertise in system design, APIs, and cross‑layer integration

Preferred Qualifications

• Experience with vLLM or similar LLM serving systems
• Familiarity with XLA / MLIR / compiler frameworks
• Exposure to AI accelerators (GPU/NPU) and runtime systems

Experience in distributed or multi-agent AI systems

EEO and Disability Accommodation

Sandisk thrives on the power and potential of diversity. As a global company, we believe the most effective way to embrace the diversity of our customers and communities is to mirror it from within. We are committed to an inclusive environment where every individual can thrive through a sense of belonging, respect and contribution. Sandisk is committed to offering opportunities to applicants with disabilities and ensuring all candidates can successfully navigate our careers website and our hiring process. Please contact us at [e-mail] to advise us of your accommodation request. In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying.