Senior AI Performance Architect

MaC VC; San Diego (CA); On-site; USD 127,000 - 218,000; Full time

Job summary

Qualcomm Technologies, Inc. is seeking an AI Accelerator Architecture Engineer to drive architectural and performance improvements for AI training systems.

You will work on HW/SW co-design, data-paths, memory subsystems, and scalable architectures to support large-scale accelerators and data centers. You will evaluate current GPU/accelerator architectures, engage with customers to capture requirements, and help define models to prove architecture value.

Qualifications

• Requires advanced degree in CS/Engineering or related field.
• 3+ years hardware engineering experience defining GPU/accelerator architectures for AI training.
• Knowledge of NVIDIA/AMD GPU architectures and capabilities.
• Familiarity with LLM architectures and HW requirements.

Responsibilities

• Analyze ML network trends and determine SW/HW impact.
• Define hardware requirements for AI training systems with customers.
• Evaluate accelerator and GPU architectures and propose enhancements.
• Architect flexible compute blocks supporting multiple data types and precisions.
• Design memory subsystems optimized for AI workloads and compute-in-memory concepts.

Skills

C++

Python

HW/SW co-design

LLM hardware requirements

Strong communication

Education

Master's degree in CS/Engineering/Info Systems

Bachelor's degree in CS/Engineering

PhD (preferred)

Tools

NVIDIA DGX/NVL72

DeepSpeed (FSDP)

NoC/SoC design tools

Job description

Company

Qualcomm Technologies, Inc.

Job Area

Engineering Group, Engineering Group > Machine Learning Engineering

General Summary

Today, more intelligence is moving to end devices, and mobile is becoming a pervasive AI platform. At the same time, data centers are expanding AI capability through widespread deployment of ML accelerators. Qualcomm envisions making AI ubiquitous - expanding beyond mobile and powering other end devices, data centers, vehicles, and things. We are inventing, developing, and commercializing power-efficient on-device AI, edge cloud AI, data center and 5G to make this a reality.

We are looking for AI Accelerator Architecture Engineers to drive functional, performance and power enhancements into the HW to enable state of the art training capabilities. AI inference and training systems must scale to a large number of accelerators, servers and racks. Our devices must be designed to scale to handle the largest of today's models.

The AI Architecture team is comprised of experts that span the full gamut from software architecture, algorithm development, kernel optimization, down to hardware accelerator block architecture and SOC design. The ideal candidate will augment the team by contributing to one or many of these areas.

Responsibilities

• Understand trends in ML network design through customer engagements and latest academic research and determine how this will affect both SW and HW design
• Work with customers to determine hardware requirements for AI training systems
• Analysis of current accelerator and GPU architectures
• Architect enhancements required for efficient training of AI models
• Design and architecture of:
  • Flexible Computational Blocks
    • Involving a variety of datatypes : floating point, fixed point, microscaling
    • Involving a variety of precision : 32/16/8/4/2/1
    • Capable of optimally performing dense and sparse GEMM, GEMV
  • Memory Technology and subystems that are optimized for a range of requirements
    • Capacity
    • Bandwidth
    • Compute in Memory, Compute near memory
  • Scale-Out and Scale-Up Architectures
    • Switches, NoCs, Codesign with Communication Collectives
  • Optimized for Power
  • Ability to perform Competitive Analysis
  • Codesign HW with SW/GenAI (LLM) requirements
  • Define performance models to prove effectiveness of architecture proposals
  • Pre-Silicon prediction of performance for various ML training workloads
  • Perform analysis of performance/area/power trade-offs for future HW and SW ML algorithms including impact of SOC components (memory and bus impacts)

Requirements

• Master's degree in Computer Science, Engineering, Information Systems, or related field
• 3+ years Hardware Engineering experience defining architecture of GPUs or accelerators used for training of AI models
• In-depth knowledge of nVidia/AMD GPU capabilities and architectures
• Knowledge of LLM architectures and their HW requirements

Preferred Skills And Experience

• Knowledge of computer architecture, digital circuits and hardware simulators
• Knowledge of communication protocols used in AI systems
• Knowledge of Network-on-Chip (NoC) designs used in System-on-Chip (SoC) designs
• Understanding of various memory technologies used in AI systems
• Experience in modeling hardware and workloads in order to extract performance and power estimates
• High-level hardware modeling experience preferred
• Knowledge of AI Training systems such as NVIDIA DGX and NVL72
• Experience training and finetuning LLMs using distributed training framework such as DeepSpeed, FSDP
• Knowledge of front-end ML frameworks (i.e.,TensorFlow, PyTorch) used for training of ML models
• Strong communication skills (written and verbal)
• Detail-oriented with strong problem-solving, analytical and debugging skills
• Demonstrated ability to learn, think and adapt in a fast-changing environment
• Ability to code in C++ and Python
• Knowledge of a variety of classes of ML models (i.e. CNN, RNN, etc)

Minimum Qualifications

• Bachelor's degree in Computer Science, Engineering, Information Systems, or related field and 2+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.
• Master's degree in Computer Science, Engineering, Information Systems, or related field and 1+ year of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.
• PhD in Computer Science, Engineering, Information Systems, or related field.

Qualcomm is an equal opportunity employer. If you are an individual with a disability and need an accommodation during the application/hiring process, rest assured that Qualcomm is committed to providing an accessible process. You may e‑mail disability‑[e-mail] or call Qualcomm's toll‑free number found here. Upon request, Qualcomm will provide reasonable accommodations to support individuals with disabilities to be able participate in the hiring process. Qualcomm is also committed to making our workplace accessible for individuals with disabilities. (Keep in mind that this email address is used to provide reasonable accommodations for individuals with disabilities. We will not respond here to requests for updates on applications or resume inquiries).

To all Staffing and Recruiting Agencies: Our Careers Site is only for individuals seeking a job at Qualcomm. Staffing and recruiting agencies and individuals being represented by an agency are not authorized to use this site or to submit profiles, applications or resumes, and any such submissions will be considered unsolicited. Qualcomm does not accept unsolicited resumes or applications from agencies. Please do not forward resumes to our jobs alias, Qualcomm employees or any other company location. Qualcomm is not responsible for any fees related to unsolicited resumes/applications.

EEO Employer: Qualcomm is an equal opportunity employer; all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or any other protected classification.

Pay Range And Other Compensation & Benefits

• $126,700.00 - $217,900.00

The above pay scale reflects the broad, minimum to maximum, pay scale for this job code for the location for which it has been posted. Even more importantly, please note that salary is only one component of total compensation at Qualcomm. We also offer a competitive annual discretionary bonus program and opportunity for annual RSU grants (employees on sales‑incentive plans are not eligible for our annual bonus). In addition, our highly competitive benefits package is designed to support your success at work, at home, and at play.