AI Software Engineer - AI Frameworks

Intel Technology India Pvt Ltd

Bengaluru

On-site

INR 4,000,000 - 7,000,000

Full time

11 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Intel Technology India Pvt Ltd in Bengaluru is seeking an AI Software Engineer to design and optimize high-performance AI frameworks for Intel accelerators and GPUs. You will implement GPU kernels, optimize scheduling and memory, and contribute to production-grade AI stacks.

You will collaborate with open-source communities like SGLang, vLLM and PyTorch, work on complex multi-layered systems, and help push performance for AI inference and training at scale.

Qualifications

  • Bachelor's or Master's degree in computer science, electronics or related field.
  • 6–12 years of professional experience in AI software/frameworks.
  • Proficient in C++ (C++14/17) and Python with parallel programming.

Responsibilities

  • Design and develop custom GPU kernels for AI framework ops to optimize performance on Intel accelerators and GPUs.
  • Optimize framework components including scheduling, memory management, and execution pipeline for throughput and latency.
  • Write and integrate high-performance kernels using GPU programming frameworks to maximize throughput.
  • Identify and implement optimization opportunities in the framework stack for production AI workloads.
  • Collaborate with open-source communities (SGLang, vLLM, PyTorch) and contribute to upstream development.
  • Debug and optimize complex multi-layered systems involving kernel execution and memory hierarchies.

Skills

C++14/17
Python
Parallel programming
GPU kernels
Kernel optimization

Education

B.Tech / M.S./M.Tech in CS or ECE

Job description

AI Software Engineer - AI Frameworks

We are seeking a dynamic and passionate AI software engineer to join Intel's Data Center and AI group (DCAI). In this role, you will design and develop optimizations for high-performance AI serving and training frameworks such as SGLang, vLLM, and PyTorch. You will contribute to Intel's AI framework software stack and help enable and optimize state-of-the-art solutions for Intel's AI accelerators and next-generation GPUs. This position requires deep expertise in framework internals, scheduling, memory management, and kernel optimization for production AI workloads.

Roles and Responsibilities
  • Design and develop custom GPU kernels for AI framework operations including attention mechanisms, collective operations, and computation primitives to optimize performance on Intel accelerators and GPUs.
  • Optimize and enhance framework components including scheduling, memory management, and execution pipeline architecture to improve throughput, latency, and resource utilization.
  • Write and integrate high-performance kernels using GPU programming frameworks to maximize throughput and minimize latency.
  • Identify and implement optimization opportunities in the framework stack for production AI workloads.
  • Collaborate with the open-source community (SGLang, vLLM, PyTorch, and others), participate in upstream development, and integrate new innovations into production software.
  • Debug and optimize complex multi-layered systems involving kernel execution, memory hierarchies, and distributed AI scenarios.
Qualifications

Bachelor's degree (B.Tech) or Master's degree (M.S./M.Tech) in Computer Science, Electronics and Communications Engineering (ECE), or a related field, with 6 to 12 years of professional experience. Advanced proficiency in C++ (C++14/17) and intermediate skills in Python and parallel programming. Proven, hands‑on experience writing and optimizing GPU kernels. Demonstrated expertise in kernel development for machine learning operations such as GEMM, attention mechanisms (including Flash Attention), collective operations, and sampling. In‑depth, hands‑on experience with AI frameworks—SGLang, vLLM, PyTorch, or similar production‑grade serving and training systems. Deep understanding of their internal architecture, scheduling mechanisms, and memory management strategies is essential. Strong knowledge of AI inference and training concepts including batching strategies, memory optimization, distributed execution, and performance tuning. Practical experience optimizing and deploying AI models at scale in production environments. Strong ability to debug complex issues in multi‑layered software systems, performance profiling, and bottleneck identification in AI frameworks. Solid understanding of computer architecture, GPU execution models, memory hierarchies, and hardware‑software co‑optimization techniques. Experience working on frameworks and platforms that have been deployed to production with high availability and performance requirements. Excellent communication skills and experience collaborating with cross-functional, geographically distributed teams.

Preferred Qualifications
  • Extensive experience developing production‑grade kernels with CUDA, CUTLASS, or Triton for various AI operations.
  • Published or open‑source contributions demonstrating kernel optimization expertise.
  • Knowledge of compiler algorithms for heterogeneous systems and kernel fusion optimizations.
  • Contributions to or deep familiarity with SGLang, vLLM, PyTorch, or other open‑source AI frameworks.
  • Experience with distributed AI workloads, multi‑GPU scheduling, and optimization across heterogeneous hardware.
  • Understanding of quantization techniques, mixed‑precision inference and training, and their integration into AI frameworks.

Job Type: Experienced Hire Shift: Shift 1 (India) Primary Location: India, Bangalore Additional Locations:

Posting Statement: All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance.

Position of Trust N/A

Work Model for this Role

This role will require an on-site presence.

* Job posting details (such such work model, location or time type) are subject to change.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Software Engineer - AI Frameworks
AI Software Engineer - AI Frameworks

Intel Corporation • Bengaluru

On-site
INR 4,000,000 - 7,000,000
AI Software Engineer - AI Frameworks
AI Software Engineer - AI Frameworks

831 Intel Technology India Pvt. Ltd. • Bengaluru

On-site
INR 4,000,000 - 7,000,000
AI Software Solutions Engineer
AI Software Solutions Engineer

Intel Corporation • Bengaluru

Hybrid
INR 4,000,000 - 6,000,000
AI Software Architect
AI Software Architect

Intel Corporation • Bengaluru

Hybrid
INR 4,000,000 - 7,000,000
AI Model Optimization Engineer
AI Model Optimization Engineer

Intel Technology India Pvt Ltd • Bengaluru

Hybrid
INR 1,200,000 - 2,400,000
GPU Architecture and AI Performance Simulation Engineer
GPU Architecture and AI Performance Simulation Engineer

Intel Corporation • Bengaluru

Hybrid
INR 4,000,000 - 7,000,000
AI System Performance Architect
AI System Performance Architect

Intel Corporation • Bengaluru

Hybrid
INR 3,500,000 - 6,000,000
LLM & Agentic AI Performance Engineer
LLM & Agentic AI Performance Engineer

Intel Corporation • Bengaluru

Hybrid
INR 380,228,000 - 570,342,000
Large Language Model and Agentic AI Performance Engineer
Large Language Model and Agentic AI Performance Engineer

Intel Technology India Pvt Ltd • Bengaluru

Hybrid
INR 3,000,000 - 6,000,000
AI System and Solutions Engineer
AI System and Solutions Engineer

Intel Corporation • Bengaluru

Hybrid
INR 1,800,000 - 2,400,000