AI Software Architect

Intel Corporation; Bengaluru; Hybrid; INR 4,000,000 - 7,000,000; Full time

Job summary

Intel Corporation in Bengaluru seeks an AI Software Architect to design, develop, and optimize AI frameworks software stack, focusing on inference serving with PyTorch vLLM and SGLang, to boost deep learning performance across hardware and software.

You will work across GPUs and AI accelerators, contribute to open-source upstreams, and build demos for new features in the Intel AI software stack.

Qualifications

• Bachelor's degree in CS/EE or related fields with 6+ years of experience; or Master's 4+ years; or PhD 2+ years.
• Proficiency in Python for developing complex software implementations.
• Intermediate expertise in C++ (C++14/17) including parallel programming.
• Hands-on experience with PyTorch, vLLM, and SGLang.
• In-depth knowledge of Large Language Models (LLMs).
• Strong understanding of computer architecture and hardware-software optimization techniques.
• Proven ability to debug complex issues across multi-layered software systems.

Responsibilities

• Design and develop software features for AI frameworks, including hardware-agnostic and hardware-aware capabilities.
• Architect and analyze state-of-the-art features across frameworks to drive development throughout the software stack.
• Enhance and extend deep learning training and inference capabilities within Intel's AI frameworks software stack.
• Optimize software stack performance for deep learning workloads on GPUs and AI accelerators.
• Participate in discussions and development within open-source communities, contributing to upstream adoption and integration.
• Debug complex issues in multi-layered software systems and ensure seamless integration within large open-source frameworks.
• Conduct performance analysis using open-source and proprietary profilers to optimize code efficiency on host and accelerator platforms.
• Build technology demonstrators and proof-of-concepts for new features in the Intel AI Software Stack for current and upcoming GPUs.

Skills

Python

C++

PyTorch

vLLM

SGLang

LLMs

Debugging

Education

Bachelor's in CS/EE or related; 6+ yrs

Master's in CS/EE or related; 4+ yrs

PhD; 2+ yrs

Tools

CUTLASS

Triton

Job description

Job Details: Job Description: The Role and Impact

We are seeking a dynamic AI Software Architect to contribute to Intel's cutting-edge AI frameworks software stack. In this role, you will design, develop, and optimize software features for AI frameworks, focusing on inference serving frameworks like PyTorch vLLM and SGLang. You will play a key role in enhancing deep learning inference and training/fine-tuning capabilities, while identifying optimization opportunities to boost workload performance across software and hardware layers.

Business Group

The position is part of Intel's Data Center Group (DCG), a global leader in driving innovation across data center platforms. The AI Software Architects team focuses on advancing AI software solutions to enable Intel's AI accelerators and next-generation GPUs, supporting Intel's mission to shape the future of technology for data-driven industries.

Key Responsibilities

• Design and develop software features for AI frameworks, including hardware-agnostic and hardware-aware capabilities.
• Architect and analyze state-of-the-art features across frameworks to drive development throughout the software stack.
• Enhance and extend deep learning training and inference capabilities within Intel's AI frameworks software stack.
• Optimize software stack performance for deep learning workloads on GPUs and AI accelerators.
• Participate in discussions and development within open-source communities, contributing to upstream adoption and integration.
• Debug complex issues in multi-layered software systems and ensure seamless integration within large open-source frameworks.
• Conduct performance analysis using open-source and proprietary profilers to optimize code efficiency on host and accelerator platforms.
• Build technology demonstrators and proof-of-concepts for new features in the Intel AI Software Stack for current and upcoming GPUs.

Qualifications

• Bachelor's degree in Computer Science, Electrical and Computer Engineering, or related fields with 6+ years of industry experience; or Master's degree with 4+ years; or PhD with 2+ years.
• Proficiency in Python for developing complex software implementations.
• Intermediate expertise in advanced C++ programming (C++14/17), including parallel programming.
• Hands‑on experience with frameworks such as PyTorch, vLLM, and SGLang.
• In‑depth knowledge of Large Language Models (LLMs).
• Strong understanding of computer architecture and hardware‑software optimization techniques.
• Proven ability to debug complex issues across multi‑layered software systems.

Preferred Qualifications

• Practical experience with deep learning models for image and video generation.
• Expertise in developing and integrating kernels (e.g., GEMM, Convolution, Flash Attention) using frameworks like CUTLASS or Triton.
• Knowledge of compiler algorithms for heterogeneous systems and Fuser optimizations.
• Effective communication skills and experience collaborating with cross‑geo teams.

Job Type: Experienced Hire

Shift: Shift 1 (India)

Primary Location: India, Bangalore

Additional Locations:

Posting Statement

All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation or any other characteristic protected by local law, regulation, or ordinance.

Position of Trust

N/A

Work Model for this Role

This role will be eligible for our hybrid work model which allows employees to split their time between working on‑site at their assigned Intel site and off‑site.

Job posting details (such as work model, location or time type) are subject to change. ADDITIONAL INFORMATION: Intel is committed to Responsible Business Alliance (RBA) compliance and ethical hiring practices. We do not charge any fees during our hiring process. Candidates should never be required to pay recruitment fees, medical examination fees, or any other charges as a condition of employment. If you are asked to pay any fees during our hiring process, please report this immediately to your recruiter. Intel’s official careers website.