AI Compiler Engineer

HypTechie; Bengaluru; On-site; INR 3,500,000 - 5,500,000; Full time

Job summary

IBM is seeking a Senior AI Compiler Engineer in Bangalore to join a team building next-generation AI compilers and device-level solutions for IBM Z systems. You will lead compiler development at the system level, optimize for GPUs/TPUs/Habana accelerators, and collaborate with cross-functional teams to integrate AI hardware/software stacks.

The role requires strong C/C++ backend programming, Python skills, and deep knowledge of AI/ML techniques, with experience in LLVM-based compiler design and

Qualifications

• Bachelor's Degree in Computer Science, Electrical Engineering, or related field.
• Senior Professional with extensive AI/ML product experience.
• Experience leading compiler-based projects and enterprise AI solutions.
• Strong knowledge of AI accelerator architectures (GPU/TPU/Habana).
• Proficiency in C/C++ backend and Python.
• Experience with model-serving platforms and AI data pipelines.

Responsibilities

• Lead AI compiler development for scalable system-level deployment.
• Design and optimize compilers for AI devices and accelerators.
• Collaborate with cross-functional teams to integrate AI stacks.
• Stay updated on AI/ML trends and contribute to libraries/frameworks.
• Translate requirements into actionable insights and communicate with stakeholders.
• Maintain code quality, performance, security, and documentation.

Skills

C/C++

Python

Full-stack knowledge

Analytical mindset

Communication skills

Education

Bachelor's Degree in CS/EE

Master’s Degree (preferred)

Tools

MLIR

XLA

TVM

LLVM

Job description

Location: Bangalore, Karnataka, India
Business Unit: IBM Z and LinuxONE
Experience Level: Senior Professional
Employment Type: Full-Time

Introduction

As an AI Compiler Engineer at IBM, you will be part of a highly skilled team focused on building next-generation AI compilers and device-level solutions tailored for IBM Z systems. This role offers the opportunity to work at the intersection of AI, systems engineering, and compiler technology, enabling high-performance, scalable AI workloads on enterprise-grade infrastructure.

Key Responsibilities

• Lead the development and deployment of AI compilers at the system level to ensure scalability, reliability, and efficiency.
• Design and optimize compiler technologies specific to AI devices and accelerators such as GPUs, TPUs, and Habana processors.
• Work hands-on with cross-functional teams to ensure smooth integration of compilers and AI hardware/software stacks.
• Stay current with emerging trends in AI/ML technologies and contribute to framework and library enhancements.
• Translate complex technical requirements into actionable insights and communicate effectively with both technical and non-technical stakeholders.
• Ensure best practices in software engineering—covering code quality, performance, security, and documentation.

Required Qualifications

Education

• Required: Bachelor’s Degree in Computer Science, Electrical Engineering, or related field
• Preferred: Master’s Degree or higher

Technical Expertise

• Hands-on experience with AI compilers such as MLIR, XLA, TVM
• Understanding of AI accelerator architectures (e.g., GPU, TPU, Habana)
• Demonstrated ability to lead compiler-based projects and enterprise AI solutions

AI Methodologies

• Strong grasp of machine learning and deep learning techniques
• Familiarity with model-serving platforms: Triton Inference Server, TGIS, vLLM
• Experience building and managing AI data pipelines

Backend Development

• Expert in C/C++ backend system programming
• Solid Python programming skills
• Full-stack project understanding and integration experience

Problem-Solving and Optimization

• Strong analytical mindset with experience optimizing AI algorithms
• Proven track record of delivering performance-focused AI solutions

Preferred Experience

• 13+ years of experience in AI/ML product development, including production-level deployments
• Proficiency in LLVM and compiler design principles
• Experience with system-level programming and AI infrastructure integration
• Commitment to continuous learning, research contributions, and innovation
• Strong communication and interpersonal skills for stakeholder engagement and cross-team collaboration