Sr Engineer- Machine Learning Engineer (AISW)

Qualcomm Technologies, Inc; Hyderabad City Taluka; On-site; PKR 191,000 - 287,000; Full time

Job summary

A leading semiconductor company seeks a Machine Learning Engineer to join their Generative AI team. The role involves developing the Qualcomm AI Runtime SDK and optimizing performance for large models. Ideal candidates have a strong background in software development, particularly in C/C++, and are knowledgeable about Generative AI technologies. Join us in shaping the future of AI on-device computing in Hyderabad.

Benefits

Equal opportunity employer

Accessible application process

Qualifications

• 2-4 years of relevant work experience in software development.
• Strong understanding of Generative AI models, LLM, LVM.
• Experience with optimizing algorithms for AI hardware accelerators.

Responsibilities

• Spearhead development of Qualcomm AI Runtime SDK.
• Push performance limits from large models.
• Stay current on GenAI advancements.

Skills

Generative AI models

C/C++ programming

Analytical skills

Communication skills

Collaboration

Education

Bachelor's degree in Engineering, Information Systems, Computer Science

Master's degree in related field

PhD in related field

Tools

PyTorch

TFLite

ONNX Runtime

OpenCL

CUDA

Job description

Machine Learning Engineer (AISW)

Company: Qualcomm India Private Limited

Job Area: Engineering Group, Engineering Group > Software Engineering

Job Location: Hyderabad

Overview

Join the exciting Generative AI team at Qualcomm focused on integrating cutting edge GenAI models on Qualcomm chipsets. The team uses Qualcomm chips’ extensive heterogeneous computing capabilities to allow inference of GenAI models on-device without a need for connection to the cloud. Our inference engine is designed to help developers run neural network models trained in a variety of frameworks on Snapdragon platforms at blazing speeds while still sipping the smallest amount of power. Utilize this power efficient hardware and Software stack to run Large Language Models (LLMs) and Large Vision Models (LVM) at near GPU speeds!

Responsibilities

In this role, you will spearhead the development and commercialization of the Qualcomm AI Runtime (QAIRT) SDK on Qualcomm SoCs. As an AI inferencing expert, you'll push the limits of performance from large models. Your mastery in deploying large C/C++ software stacks using best practices will be essential. You'll stay on the cutting edge of GenAI advancements, understanding LLMs/Transformers and the nuances of edge-based GenAI deployment. Most importantly, your passion for the role of edge in AI's evolution will be your driving force.

Requirements

• Master’s/Bachelor’s degree in computer science or equivalent.
• 2-4 years of relevant work experience in software development.
• Good understanding of Generative AI models – LLM, LVM, LMMs and building blocks (self-attention, cross attention, kv caching etc.).
• Experience with optimizing algorithms for AI hardware accelerators.
• Strong in C/C++ programming, Design Patterns and OS concepts.
• Excellent analytical and debugging skills.
• Good communication skills (verbal, presentation, written).
• Ability to collaborate across a globally diverse team and multiple interests.

Minimum Qualifications

• Bachelor's degree in Engineering, Information Systems, Computer Science, or related field and 2+ years of Software Engineering or related work experience.
• Master's degree in Engineering, Information Systems, Computer Science, or related field and 1+ year of Software Engineering or related work experience.
• PhD in Engineering, Information Systems, Computer Science, or related field.
• 2+ years of academic or work experience with Programming Language such as C, C++, Java, Python, etc.

Preferred Qualifications

• Strong understanding of SIMD processor architecture and system design.
• Proficiency in object-oriented software development and familiarity.
• Strong background in kernel development for SIMD architectures.
• Familiarity with frameworks like llama.cpp, MLX, and MLC is a plus.
• Good knowledge of PyTorch, TFLite, and ONNX Runtime is preferred.
• Experience with parallel computing systems and languages like OpenCL and CUDA is a plus.

Qualcomm is an equal opportunity employer. If you are an individual with a disability and need an accommodation during the application/hiring process, rest assured that Qualcomm is committed to providing an accessible process. You may e-mail [e-mail] or call Qualcomm's toll-free number found on the site. Upon request, Qualcomm will provide reasonable accommodations to support individuals with disabilities to be able participate in the hiring process.

If you would like more information about this role, please contact Qualcomm Careers.