Principal Software Development Engineer

Advanced Micro Devices, Inc

Southwestern Ontario

On-site

CAD 120,000 - 170,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AMD is seeking a strategic software development engineer to lead performance improvements for ML models on AMD GPUs. You will join a core team optimizing inference and training workloads across ROCm, interfacing with frameworks like PyTorch, vLLM, and llama.cpp on the latest hardware.

The role requires strong C/C++ and Python skills, leadership capabilities, and the ability to collaborate across AMD and the open-source community to drive innovative solutions.

Qualifications

  • Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent.
  • Strong programming background in C/C++ and Python.
  • Experience with ML frameworks and inference engines such as PyTorch, vLLM, or llama.cpp.

Responsibilities

  • Analyze and optimize the performance of ML models running on AMD GPUs with the ROCm stack.
  • Optimize code across multiple software layers, including PyTorch, vLLM, llama.cpp, and ROCm libraries, in both Python and C++.
  • Work with AMD's architecture specialists to improve future products.
  • Apply a data-driven approach, using profiling and benchmarking, to target optimization efforts.
  • Stay informed of software and hardware trends and innovations, especially in ML models, algorithms, and GPU architecture.
  • Design and develop new groundbreaking AMD technologies.
  • Contribute to upstream open-source projects and develop technical relationships with peers, partners, and open-source communities.

Skills

C/C++
Python
Linux
Performance optimization
Leadership
Open-source

Education

Bachelor's or Master's in CS/CE/EE

Tools

PyTorch
vLLM
llama.cpp
HIP/CUDA/Triton
ROCm libraries

Job description

ADVANCE YOUR CAREER. ADVANCE THE WORLD.


At AMD, we believetechnology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMDis shapingthefuture.


Whetheryou’redesigning next-gen processors, enabling AI breakthroughs, orbringing leading edge products to market, every role at AMD contributes to something bigger— technologythat moves the world forward.Join us and, together, we’ll advance your career.


PMTS SOFTWARE DEVELOPMENT ENGINEER


THE ROLE:

AMD is looking for a strategic software engineering lead who is passionate about improving the performance of machine learning models on AMD GPUs. You will be a member of a core team of incredibly talented industry specialists. The team optimizes ML inference and training workloads across the ROCm software stack, from frameworks like PyTorch, vLLM, and llama.cpp down to ROCm libraries and GPU kernels. You will work with the very latest hardware and software technology.


THE PERSON:

The ideal candidate should be passionate about software engineering and performance optimization, and have the leadership skills to drive sophisticated issues to resolution. They should be comfortable working across multiple layers of the software stack in both Python and C++. They should be able to communicate effectively and work well with different teams across AMD and with open-source communities.


KEY RESPONSIBILITIES:


  • Analyze and optimize the performance of ML models running on AMD GPUs with the ROCm stack

  • Optimize code across multiple software layers, including PyTorch, vLLM, llama.cpp, and ROCm libraries, in both Python and C++

  • Work with AMD's architecture specialists to improve future products

  • Apply a data-driven approach, using profiling and benchmarking, to target optimization efforts

  • Stay informed of software and hardware trends and innovations, especially in ML models, algorithms, and GPU architecture

  • Design and develop new groundbreaking AMD technologies

  • Participate in new ASIC and hardware bring-ups

  • Debug and fix existing issues, and research alternative, more efficient ways to accomplish the same work

  • Contribute to upstream open-source projects and develop technical relationships with peers, partners, and open-source communities

  • Share AI-assisted workflows and best practices across the team to raise overall engineering productivity

  • Critically evaluate AI-generated code and analysis for correctness and performance before relying on it


PREFERRED EXPERIENCE:


  • Strong programming background, C/C++ and Python preferred



  • Experience with ML frameworks and inference engines such as PyTorch, vLLM, or llama.cpp

  • Experience with GPU programming (HIP, CUDA, or Triton) and performance optimization is a plus

  • Ability to write high-quality code with keen attention to detail

  • Experience with modern concurrent programming and threading APIs

  • Experience with Linux development

  • Experience with software development processes and tools such as debuggers, source code control systems (GitHub), and profilers

  • Effective communication and problem-solving skills

  • Motivating leader with good interpersonal skills


ACADEMIC CREDENTIALS:


  • Bachelor’s or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent


Benefits offered are described: AMD benefits at a glance.


AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.


AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.


This posting is for an existing vacancy.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Software Development Engineer
Principal Software Development Engineer

Advanced Micro Devices, Inc • Vancouver

On-site
CAD 120,000 - 160,000
AI Systems Engineer – AI Model (Training & Inference)
AI Systems Engineer – AI Model (Training & Inference)

Advanced Micro Devices, Inc. • Markham

On-site
CAD 140,000 - 190,000
Principal Software Development Engineer
Principal Software Development Engineer

Advanced Micro Devices, Inc. • Markham

On-site
CAD 120,000 - 180,000
Principal Engineer - Gen AI training and inferencing
Principal Engineer - Gen AI training and inferencing

Advanced Micro Devices, Inc. • Markham

Hybrid
CAD 120,000 - 160,000
Comprehensive benefits package
Professional development opportunities
Technical Marketing Specialist (1 year contract)
Technical Marketing Specialist (1 year contract)

Advanced Micro Devices, Inc. • Markham

On-site
CAD 70,000 - 110,000
Software Development Engineer
Software Development Engineer

Advanced Micro Devices, Inc. • Markham

On-site
CAD 84,720 - 127,080
System Validation Engineer – Data Center GPU
System Validation Engineer – Data Center GPU

Advanced Micro Devices, Inc. • Markham

On-site
CAD 110,000 - 140,000
Benefits at a glance
RTL/Firmware Design Engineer
RTL/Firmware Design Engineer

Advanced Micro Devices, Inc. • Markham

On-site
CAD 65,000 - 90,000
CPU Performance Engineer
CPU Performance Engineer

Advanced Micro Devices, Inc. • Markham

On-site
CAD 110,000 - 160,000
Sr. Systems Design Engineer - Data Center GPU
Sr. Systems Design Engineer - Data Center GPU

Advanced Micro Devices, Inc. • Markham

On-site
CAD 110,000 - 170,000