Staff Machine Learning Engineer – AI/ML Compiler

Qualcomm Innovation Center, Inc.

Santa Clara (CA)

On-site

USD 174,000 - 261,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Qualcomm Technologies, Inc. is seeking a skilled Compiler Engineer to join the Qualcomm AI Hub Compiler team in Santa Clara, CA.

You will design and maintain end-to-end ML compilation pipelines, collaborate across CPU, GPU, and NPU backends, and advance automated CI/CD workflows for model onboarding. The role requires a BS in CS/Engineering or related field with 4+ years in hardware/software/systems, plus strong Python/C++ and ML compiler experience.

Qualifications

  • Bachelor's degree in Computer Science, Engineering, Information Systems, or related field with 4+ years of relevant experience.
  • Experience in hardware/software/systems engineering and model compilation workflows.
  • Strong background in ML infrastructure, compilers, or related performance optimization.

Responsibilities

  • Design, develop, and maintain end-to-end ML compilation pipelines for Qualcomm AI Hub Workbench.
  • Build ONNX-based and PyTorch compilation paths and ensure compatibility across runtimes.
  • Collaborate with QAIRT and QNN teams to optimize execution on CPU, GPU, and NPU backends.

Skills

Hardware Engineering
Software Engineering
Systems Engineering
ML/AI fundamentals

Education

Bachelor's degree in CS/Engineering/IS

Tools

PyTorch
ONNX
ONNXRuntime
MLIR
TVM
LiteRT
QAIRT
QNN

Job description

General Summary:
About the Role

Qualcomm AI Hub is the platform for on-device AI — enabling developers to easily integrate, optimize , and deploy ML models on Qualcomm devices. Qualcomm AI Hub Workbench lets developers compile trained PyTorch or ONNX models into deployable artifacts targeting a variety of runtimes — LiteRT , ONNXRuntime , or Qualcomm AI Engine Direct SDK (QAIRT) — and profile and validate them on real Qualcomm devices hosted in the cloud.

Join the Qualcomm AI Hub Compiler team and own the infrastructure that powers these model compilations. You will work across the full compilation pipeline — from model ingestion and graph optimization to backend dispatch across CPU, GPU, and NPU — ensuring models compile correctly, execute efficiently, and scale across a growing catalog of on-device use cases spanning vision, audio, speech, and multi-modal models.

What You'll Do

Design, develop, and maintain the end-to-end compilation pipeline powering Qualcomm AI Hub Workbench, from PyTorch and ONNX model ingestion through graph optimization to deployable artifacts targeting LiteRT , ONNXRuntime , or QAIRT on Snapdragon SoCs

Build and maintain ONNX-based compilation paths using ONNX IR: graph transformation passes, op validation, andopset compatibility handling

Build and maintainPyTorch compilation paths consuming torch.export output, including dynamic shapes, custom ops, and ATen IR decomposition

Contribute toONNXRuntime QNN execution provider: graph optimizations, graph partitioning, and op validation and lowerings

Collaborate with QAIRT and QNN teams to ensure correct and efficient model execution across CPU, GPU, and NPU backends

Build tooling to analyze, profile, and debug compilation failures, accuracy regressions, and performance degradations; develop clear, actionable developer-facing diagnostics

Own compilation and validation of models published on Qualcomm AI Hub, ensuring correct conversion and verified performance across supported runtime targets

Build andmaintain automated compilation pipelines and CI/CD evaluation harnesses to scale model onboarding as the Qualcomm AI Hub model catalog grows

Partner with internal Business Units to onboard models through Qualcomm AI Hub compilation workflows, translating deployment constraints (target SoC, latency budgets, memory limits) into concrete compilation strategies

Author technical documentation, tutorials, and example notebooks for the Qualcomm AI Hub developer community

Minimum Qualifications
  • Bachelor's degree in Computer Science, Engineering, Information Systems, or related field and 4+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.


Company:Qualcomm Technologies, Inc.Job Area:Engineering Group, Engineering Group > Machine Learning Engineering

About the Role

Qualcomm AI Hub is the platform for on-device AI — enabling developers to easily integrate, optimize , and deploy ML models on Qualcomm devices. Qualcomm AI Hub Workbench lets developers compile trained PyTorch or ONNX models into deployable artifacts targeting a variety of runtimes — LiteRT , ONNXRuntime , or Qualcomm AI Engine Direct SDK (QAIRT) — and profile and validate them on real Qualcomm devices hosted in the cloud.

Join the Qualcomm AI Hub Compiler team and own the infrastructure that powers these model compilations. You will work across the full compilation pipeline — from model ingestion and graph optimization to backend dispatch across CPU, GPU, and NPU — ensuring models compile correctly, execute efficiently, and scale across a growing catalog of on-device use cases spanning vision, audio, speech, and multi-modal models.

What You'll Do
Compiler Pipeline & Infrastructure
  • Design, develop, and maintain the end-to-end compilation pipeline powering Qualcomm AI Hub Workbench, from PyTorch and ONNX model ingestion through graph optimization to deployable artifacts targeting LiteRT , ONNXRuntime , or QAIRT on Snapdragon SoCs
  • Build and maintain ONNX-based compilation paths using ONNX IR: graph transformation passes, op validation, andopset compatibility handling
  • Build and maintainPyTorch compilation paths consuming torch.export output, including dynamic shapes, custom ops, and ATen IR decomposition
  • Contribute toONNXRuntime QNN execution provider: graph optimizations, graph partitioning, and op validation and lowerings
  • Collaborate with QAIRT and QNN teams to ensure correct and efficient model execution across CPU, GPU, and NPU backends
  • Build tooling to analyze, profile, and debug compilation failures, accuracy regressions, and performance degradations; develop clear, actionable developer-facing diagnostics
Model Catalog, Automation & Collaboration
  • Own compilation and validation of models published on Qualcomm AI Hub, ensuring correct conversion and verified performance across supported runtime targets
  • Build andmaintain automated compilation pipelines and CI/CD evaluation harnesses to scale model onboarding as the Qualcomm AI Hub model catalog grows
  • Partner with internal Business Units to onboard models through Qualcomm AI Hub compilation workflows, translating deployment constraints (target SoC, latency budgets, memory limits) into concrete compilation strategies
  • Author technical documentation, tutorials, and example notebooks for the Qualcomm AI Hub developer community
Minimum Qualifications
  • Bachelor's degree in Computer Science, Engineering, Information Systems, or related field and 4+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.
  • Master's degree in Computer Science, Engineering, Information Systems, or related field and 3+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.
  • PhD in Computer Science, Engineering, Information Systems, or related field and 2+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.
Preferred Qualifications
  • 3+ years of industry experience in ML infrastructure, compiler engineering, or AI framework development
  • Proficient in Python and C++
  • Solid understanding of ML compiler concepts (graph IRs, operator fusion, shape inference, lowering passes, backend partitioning) and hands‑on experience with one or more compiler stacks such as MLIR, ONNX, or TVM
  • Experience withPyTorch model export ( torch.export , torch.compile , FX, ATen IR) and on‑device deployment frameworks such as LiteRT , ExecuTorch , or ONNXRuntime
  • Familiarity with SoC‑level constraints (memory bandwidth, compute precision, NPU/DSP execution) and hardware‑specific runtimes such as QAIRT/QNN is a plus
  • Experience building automated CI/CD pipelines for model compilation and validation at scale
  • Strong written and verbal communication skills;proficiency with git and software engineering best practices
Level of Responsibility
  • Works independently on open-ended compiler and infrastructure challenges
  • Provides technical guidance and mentorship to team members
  • Decision‑making has broad impact — affecting compilation correctness, runtime performance, and the developer experience across Qualcomm AI Hub
  • Communicates complex compiler and runtime concepts to varied audiences: SoC engineers, BU partners, and external ML developers
  • Has meaningful influence on the Qualcomm AI Hub compiler roadmap, model catalog strategy, and cross‑team runtime integration priorities

Qualcomm is an equal opportunity employer. If you are an individual with a disability and need an accommodation during the application/hiring process, rest assured that Qualcomm is committed to providing an accessible process. You may e-mail disability‑accomodations@qualcomm.com or call Qualcomm's toll‑free number found here . Upon request, Qualcomm will provide reasonable accommodations to support individuals with disabilities to be able participate in the hiring process. Qualcomm is also committed to making our workplace accessible for individuals with disabilities. (Keep in mind that this email address is used to provide reasonable accommodations for individuals with disabilities. We will not respond here to requests for updates on applications or resume inquiries).

To all Staffing and Recruiting Agencies

Our Careers Site is only for individuals seeking a job at Qualcomm. Staffing and recruiting agencies and individuals being represented by an agency are not authorized to use this site or to submit profiles, applications or resumes, and any such submissions will be considered unsolicited. Qualcomm does not accept unsolicited resumes or applications from agencies. Please do not forward resumes to our jobs alias, Qualcomm employees or any other company location. Qualcomm is not responsible for any fees related to unsolicited resumes/applications.

EEO Employer

Qualcomm is an equal opportunity employer; all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or any other protected classification.

Qualcomm expects its employees to abide by all applicable policies and procedures, including but not limited to security and other requirements regarding protection of Company confidential information and other confidential and/or proprietary information, to the extent those requirements are permissible under applicable law.

Pay range and Other Compensation & Benefits:

$174,000.00 - $261,000.00
The above pay scale reflects the broad, minimum to maximum, pay scale for this job code for the location for which it has been posted. Even more importantly, please note that salary is only one component of total compensation at Qualcomm. We also offer a competitive annual discretionary bonus program and opportunity for annual RSU grants (employees on sales‑incentive plans are not eligible for our annual bonus). In addition, our highly competitive benefits package is designed to support your success at work, at home, and at play. Your recruiter will be happy to discuss all that Qualcomm has to offer – and you can review more details about our US benefits at this link .

If you would like more information about this role, please contact Qualcomm Careers .

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Staff Software Engineer, AI Model Enablement & Software Tools
Senior Staff Software Engineer, AI Model Enablement & Software Tools

Qualcomm • San Diego (CA)

On-site
USD 194,000 - 292,000
Senior Machine Learning Engineer – AI/ML Compiler
Senior Machine Learning Engineer – AI/ML Compiler

Qualcomm • Santa Clara (CA)

On-site
USD 151,000 - 227,000
Senior Staff Software Engineer, AI Model Enablement & Software Tools
Senior Staff Software Engineer, AI Model Enablement & Software Tools

QUALCOMM, Inc. • San Diego (CA)

On-site
USD 194,000 - 292,000
Discretionary bonus
RSU grants
Senior Machine Learning Engineer – AI/ML Compiler
Senior Machine Learning Engineer – AI/ML Compiler

QUALCOMM, Inc. • Santa Clara (CA)

On-site
USD 151,000 - 227,000
Senior Machine Learning Engineer – AI/ML Compiler
Senior Machine Learning Engineer – AI/ML Compiler

QUALCOMM, Inc. • Santa Clara (CA)

On-site
USD 151,000 - 227,000
Annual bonus
RSU grants
Benefits package
Senior Director of Engineering - AI Platform
Senior Director of Engineering - AI Platform

QUALCOMM, Inc. • San Diego (CA)

On-site
USD 282,000 - 422,000
Annual bonus
RSU grants
Comprehensive benefits
Machine Learning Research Engineer, Senior
Machine Learning Research Engineer, Senior

Qualcomm Incorporated • San Diego (CA)

On-site
USD 141,000 - 211,000
Senior AI Performance Architect
Senior AI Performance Architect

Qualcomm • Austin (TX)

On-site
USD 127,000 - 190,000
Machine Learning Research Engineer, Senior
Machine Learning Research Engineer, Senior

Qualcomm • San Diego (CA)

On-site
USD 141,000 - 211,000
Senior AI Performance Architect
Senior AI Performance Architect

Qualcomm • San Diego (CA)

On-site
USD 127,000 - 190,000