Artificial Intelligence Software Architect

Intel Technology India Pvt Ltd; Bengaluru; Hybrid; INR 400,000 - 700,000; Full time

Benefits offered by this job

Hybrid work model

Job summary

Intel Technology India Pvt Ltd in Bengaluru, India seeks an AI Software Architect to design, develop, and optimize AI frameworks software, focusing on inference serving with PyTorch vLLM and SGLang. You will enhance deep learning training/inference, and optimize workloads across hardware and software layers.

The role is part of Intel's Data Center Group and involves collaboration with open-source projects, performance profiling, and building demonstrators for new features on current and upcoming

Qualifications

• Bachelor's degree with 4+ years of AI software or related field.
• Strong Python and C++ programming abilities.
• Experience with PyTorch, vLLM, and SGLang in AI frameworks.

Responsibilities

• Design software features for AI frameworks across hardware-agnostic and hardware-aware contexts.
• Architect and analyze features to drive development across the stack.
• Enhance training and inference capabilities of Intel AI software.
• Optimize performance of workloads on GPUs and accelerators.
• Collaborate with open-source communities and upstream projects.
• Debug complex issues in multi-layered software systems.
• Profile performance using open-source and proprietary tools.

Skills

Python

C++

LLMs

Parallel programming

Software optimization

Education

Bachelor's degree in Computer Science or Electrical & Computer Engineering

Tools

PyTorch

vLLM

SGLang

CUTLASS

Triton

Job description

AI Software Architect Job Details: Job Description: The Role and Impact We are seeking a dynamic AI Software Architect to contribute to Intel's cutting-edge AI frameworks software stack. In this role, you will design, develop, and optimize software features for AI frameworks, focusing on inference serving frameworks like PyTorch vLLM and SGLang. You will play a key role in enhancing deep learning inference and training/fine-tuning capabilities, while identifying optimization opportunities to boost workload performance across software and hardware layers.

Business Group The position is part of Intel's Data Center Group (DCG), a global leader in driving innovation across data center platforms. The AI Software Architects team focuses on advancing AI software solutions to enable Intel's AI accelerators and next-generation GPUs, supporting Intel's mission to shape the future of technology for data-driven industries.

Key Responsibilities

• Design and develop software features for AI frameworks, including hardware-agnostic and hardware-aware capabilities.
• Architect and analyze state-of-the-art features across frameworks to drive development throughout the software stack.
• Enhance and extend deep learning training and inference capabilities within Intel's AI frameworks software stack.
• Optimize software stack performance for deep learning workloads on GPUs and AI accelerators.
• Participate in discussions and development within open-source communities, contributing to upstream adoption and integration.
• Debug complex issues in multi-layered software systems and ensure seamless integration within large open-source frameworks.
• Conduct performance analysis using open-source and proprietary profilers to optimize code efficiency on host and accelerator platforms.
• Build technology demonstrators and proof-of-concepts for new features in the Intel AI Software Stack for current and upcoming GPUs.

Qualifications

Minimum Qualifications

• Bachelor's degree in Computer Science, Electrical and Computer Engineering, or related fields with 6+ years of industry experience; or Master's degree with 4+ years; or PhD with 2+ years.
• Proficiency in Python for developing complex software implementations.
• Intermediate expertise in advanced C++ programming (C++14/17), including parallel programming.
• Hands-on experience with frameworks such as PyTorch, vLLM, and SGLang.
• In-depth knowledge of Large Language Models (LLMs).
• Strong understanding of computer architecture and hardware-software optimization techniques.
• Proven ability to debug complex issues across multi-layered software systems.

Preferred Qualifications

• Practical experience with deep learning models for image and video generation.
• Expertise in developing and integrating kernels (e.g., GEMM, Convolution, Flash Attention) using frameworks like CUTLASS or Triton.
• Knowledge of compiler algorithms for heterogeneous systems and Fuser optimizations.
• Effective communication skills and experience collaborating with cross-geo teams.

Join us to drive innovation in AI software solutions and shape the future of data-driven technologies with Intel's cutting-edge platforms.

Job Type: Experienced Hire Shift: Shift 1 (India) Primary Location: India, Bangalore Additional Locations:

Posting Statement: All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance.

Position of Trust N/A

Work Model for this Role This role will be eligible for our hybrid work model which allows employees to split their time between working on-site at their assigned Intel site and off-site. * Job posting details (such work model, location or time type) are subject to change. * ADDITIONAL INFORMATION: Intel is committed to Responsible Business Alliance (RBA) compliance and ethical hiring practices. We do not charge any fees during our hiring process. Candidates should never be required to pay recruitment fees, medical examination fees, or any other charges as a condition of employment. If you are asked to pay any fees during our hiring process, please report this immediately to your recruiter.