AI SW Stack Deployment Architect (12+ years)

Sandisk; Bengaluru; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

Sandisk is seeking a Software Architect with 12+ years of experience to lead the application/framework layer and deployment for the Next Generation Accelerator AI platform. The role ensures correct, performant, and scalable model execution across vLLM, PyTorch, TensorFlow/XLA, and production deployment.

You will own LLM execution behavior, define APIs, and drive end-to-end deployment workflows while collaborating with cross-functional teams to deliver enterprise-grade AI solutions.

Qualifications

• 10+ years in AI/ML systems or software architecture.
• Strong experience with PyTorch / Transformers / LLMs.
• Hands-on experience with LLM deployment and scalable inference engine.

Responsibilities

• Architect integration of AI frameworks and deployment stacks.
• Define framework → compiler → runtime APIs and contracts.
• Own LLM execution behavior (batching, KV cache, streaming).
• Design end-to-end deployment workflows (packaging, versioning, reproducibility).
• Drive performance optimization across model → framework → runtime.
• Collaborate with compiler, runtime, and low-level SW teams.
• Support customer workloads, model onboarding, and debugging.
• Own customer-visible AI execution and deployment on the accelerator.

Skills

PyTorch

Transformers

LLMs

AI/ML systems

Job description

Sandisk understands how people and businesses consume data and we relentlessly innovate to deliver solutions that enable today’s needs and tomorrow’s next big ideas. With a rich history of groundbreaking innovations in Flash and advanced memory technologies, our solutions have become the beating heart of the digital world we’re living in and that we have the power to shape.

Sandisk meets people and businesses at the intersection of their aspirations and the moment, enabling them to keep moving and pushing possibility forward. We do this through the balance of our powerhouse manufacturing capabilities and our industry-leading portfolio of products that are recognized globally for innovation, performance and quality.

Sandisk has two facilities recognized by the World Economic Forum as part of the Global Lighthouse Network for advanced 4IR innovations. These facilities were also recognized as Sustainability Lighthouses for breakthroughs in efficient operations. With our global reach, we ensure the global supply chain has access to the Flash memory it needs to keep our world moving forward.

Description

Role Overview

We are looking for a Software Architect (12+ years experience) to lead the application/framework layer and deployment stack for the Next Generation Accelerator AI platform. This role owns how models run on Next Generation Accelerator—from vLLM / PyTorch / TensotFlow/XLA to production deployment—ensuring correctness, performance, and scalability.

Key Responsibilities

• Architect integration of vLLM, PyTorch, and TensorFlow, JAX/XLA into Next Generation Accelerator stack
• Define framework → compiler → runtime APIs and contracts
• Own LLM execution behavior (batching, KV cache, streaming inference)
• Design and implement end-to-end deployment workflows (packaging, versioning, reproducibility)
• Drive performance optimization across model → framework → runtime
• Work cross-functionally with compiler, runtime, and low-level SW teams
• Support customer workloads, model onboarding, and debugging Impact
• Own customer-visible AI execution and deployment on Next Generation Accelerator, closing the gap between models and system performance, and enabling enterprise-grade AI solutions

Required Qualifications

• 10+ years in AI/ML systems or software architecture Strong experience with PyTorch / Transformers / LLMs
• Hands-on experience with LLM deployment and scalable inference engine

Additional Information

Sandisk thrives on the power and potential of diversity. As a global company, we believe the most effective way to embrace the diversity of our customers and communities is to mirror it from within. We believe the fusion of various perspectives results in the best outcomes for our employees, our company, our customers, and the world around us. We are committed to an inclusive environment where every individual can thrive through a sense of belonging, respect and contribution.

Sandisk is committed to offering opportunities to applicants with disabilities and ensuring all candidates can successfully navigate our careers website and our hiring process. Please contact us at [e-mail] to advise us of your accommodation request. In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying.