Engineer

Qualcomm; Hyderabad; On-site; INR 1,800,000 - 2,800,000; Full time

Job summary

Qualcomm India Private Limited is seeking an AI inference expert to spearhead the QAIRT SDK on Qualcomm SoCs, enabling GenAI on-device performance with low power consumption.

You will deploy large C/C++ stacks, optimize for AI hardware accelerators, and stay at the forefront of LLMs/LVMs and edge deployment across diverse global teams.

Qualifications

• Master’s/Bachelor’s degree in computer science or equivalent.
• 3+ years of relevant work experience in software development.
• Strong understanding of Generative AI models – LLM, LVM and building blocks; Floating-point, Fixed-point representations and Quantization concepts.
• Experience with optimizing algorithms for AI hardware accelerators (like CPU/GPU/NPU).
• Strong development skills in C/C++.
• Excellent analytical and debugging skills.
• Good communication skills (verbal, presentation, written).
• Ability to collaborate across a globally diverse team and multiple interests.

Responsibilities

• Spearhead the development and commercialization of the Qualcomm AI Runtime (QAIRT) SDK on Qualcomm SoCs.
• Push the limits of performance from large models as an AI inferencing expert.
• Deploy large C/C++ software stacks using best practices for edge GenAI.
• Stay on the cutting edge of GenAI advancements and edge-based deployment.

Skills

C/C++

Generative AI

LLMs

Edge AI

Education

Bachelor's or Master's in CS/Engineering

Tools

llama.cpp

MLX

MLC

PyTorch

TFLite

ONNX Runtime

Job description

Company

Qualcomm India Private Limited

Job Area

Engineering Group, Engineering Group > Software Applications Engineering

General Summary

Job Description

More Details Below

Join the exciting Generative AI team at Qualcomm focused on integrating cutting edge GenAI models on Qualcomm chipsets. The team uses Qualcomm chips’ extensive heterogeneous computing capabilities to allow inference of GenAI models on-device without a need for connection to the cloud. Our inference engine is designed to help developers run neural network models trained in a variety of frameworks on Snapdragon platforms at blazing speeds while still sipping the smallest amount of power. Utilize this power efficient hardware and Software stack to run traditional models, Large Language Models (LLMs) and Large Vision Models (LVM) at near GPU speeds!

Responsibilities

In this role, you will spearhead the development and commercialization of the Qualcomm AI Runtime (QAIRT) SDK on Qualcomm SoCs. As an AI inferencing expert, you'll push the limits of performance from large models. Your mastery in deploying large C/C++ software stacks using best practices will be essential. You'll stay on the cutting edge of GenAI advancements, understanding LLMs/Transformers and the nuances of edge-based GenAI deployment. Most importantly, your passion for the role of edge in AI's evolution will be your driving force.

Requirements

Master’s/Bachelor’s degree in computer science or equivalent. 3+ years of relevant work experience in software development. (Bachelors) Strong understanding of Generative AI models – LLM, LVM and LLMs and building blocks Floating-point, Fixed-point representations and Quantization concepts. Experience with optimizing algorithms for AI hardware accelerators (like CPU/GPU/NPU). Strong development skills in C/C++. Excellent analytical and debugging skills. Good communication skills (verbal, presentation, written). Ability to collaborate across a globally diverse team and multiple interests.

Preferred Qualifications

• Strong understanding of SIMD processor architecture and system design.
• Proficiency in object-oriented software development.
• Familiarity with Linux and Windows environment
• Strong background in kernel development for SIMD architectures.
• Familiarity with frameworks like llama.cpp, MLX, and MLC is a plus.
• Good knowledge of PyTorch, TFLite, and ONNX Runtime is preferred.
• Experience with parallel computing systems and Assembly is a plus.

Minimum Qualifications

• Bachelor's degree in Engineering, Information Systems, Computer Science, or related field.

Applicants

Qualcomm is an equal opportunity employer. If you are an individual with a disability and need an accommodation during the application/hiring process, rest assured that Qualcomm is committed to providing an accessible process. You may e-mail disability‑[e-mail] or call Qualcomm's toll-free number found here. Upon request, Qualcomm will provide reasonable accommodations to support individuals with disabilities to be able participate in the hiring process. Qualcomm is also committed to making our workplace accessible for individuals with disabilities. (Keep in mind that this email address is used to provide reasonable accommodations for individuals with disabilities. We will not respond here to requests for updates on applications or resume inquiries). Qualcomm expects its employees to abide by all applicable policies and procedures, including but not limited to security and other requirements regarding protection of Company confidential information and other confidential and/or proprietary information, to the extent those requirements are permissible under applicable law.