Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
Intel Technology India Pvt Ltd in Bengaluru is seeking an AI Software Engineer to design and optimize high-performance AI frameworks for Intel accelerators and GPUs. You will implement GPU kernels, optimize scheduling and memory, and contribute to production-grade AI stacks.
You will collaborate with open-source communities like SGLang, vLLM and PyTorch, work on complex multi-layered systems, and help push performance for AI inference and training at scale.
We are seeking a dynamic and passionate AI software engineer to join Intel's Data Center and AI group (DCAI). In this role, you will design and develop optimizations for high-performance AI serving and training frameworks such as SGLang, vLLM, and PyTorch. You will contribute to Intel's AI framework software stack and help enable and optimize state-of-the-art solutions for Intel's AI accelerators and next-generation GPUs. This position requires deep expertise in framework internals, scheduling, memory management, and kernel optimization for production AI workloads.
Bachelor's degree (B.Tech) or Master's degree (M.S./M.Tech) in Computer Science, Electronics and Communications Engineering (ECE), or a related field, with 6 to 12 years of professional experience. Advanced proficiency in C++ (C++14/17) and intermediate skills in Python and parallel programming. Proven, hands‑on experience writing and optimizing GPU kernels. Demonstrated expertise in kernel development for machine learning operations such as GEMM, attention mechanisms (including Flash Attention), collective operations, and sampling. In‑depth, hands‑on experience with AI frameworks—SGLang, vLLM, PyTorch, or similar production‑grade serving and training systems. Deep understanding of their internal architecture, scheduling mechanisms, and memory management strategies is essential. Strong knowledge of AI inference and training concepts including batching strategies, memory optimization, distributed execution, and performance tuning. Practical experience optimizing and deploying AI models at scale in production environments. Strong ability to debug complex issues in multi‑layered software systems, performance profiling, and bottleneck identification in AI frameworks. Solid understanding of computer architecture, GPU execution models, memory hierarchies, and hardware‑software co‑optimization techniques. Experience working on frameworks and platforms that have been deployed to production with high availability and performance requirements. Excellent communication skills and experience collaborating with cross-functional, geographically distributed teams.
Job Type: Experienced Hire Shift: Shift 1 (India) Primary Location: India, Bangalore Additional Locations:
Posting Statement: All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance.
Position of Trust N/A
This role will require an on-site presence.
* Job posting details (such such work model, location or time type) are subject to change.