AI Model, Framework, and GPU Software Engineer – Agentic AI

AMD

Markham

On-site

CAD 110,000 - 160,000

Full time

6 days ago
Be an early applicant
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AMD in Markham, Ontario seeks an AI Model, Framework, and GPU Software Engineer to advance state-of-the-art AI software running on GPU-accelerated platforms. You will work across the stack from model bring-up to performance optimization and contribute to open-source ecosystems.

You thrive in a fast-moving, collaborative environment, own difficult technical challenges, and communicate clearly with distributed teams across software, compiler, and product areas.

Qualifications

  • Experience developing software in C/C++ and/or Python on Linux and Windows platforms.
  • Strong understanding of AI/ML concepts, model architectures, and inference workflows.
  • Experience with AI frameworks and technologies such as PyTorch, vLLM, llama.cpp, or similar ecosystems.
  • Familiarity with GPU acceleration, performance optimization, compiler technologies, or low-level programming.
  • Experience analyzing and improving the performance of AI workloads and operators.
  • Open-source software development experience and interest in emerging AI technologies are a plus.

Responsibilities

  • Develop AI software solutions that enable efficient execution of models and frameworks on GPU-accelerated platforms.
  • Enable and optimize AI frameworks, inference stacks, and agentic AI software.
  • Bring up, analyze, and improve the performance of state-of-the-art AI models.
  • Optimize AI workloads across the software stack, from model architecture to GPU acceleration.
  • Collaborate with cross-functional teams to deliver end-to-end AI software features and capabilities.
  • Contribute to open-source AI software projects and support customer enablement efforts.

Skills

C/C++
Python
Linux/Windows
PyTorch
vLLM
llama.cpp
GPU acceleration
Open-source
Performance optimization

Education

Bachelor’s, Master, or PhD in Computer Science, Electrical Engineering or relevant fields preferred

Job description

ADVANCE YOUR CAREER. ADVANCE THE WORLD.

At AMD, we believetechnology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMD is shaping the future.

Whether you’redesigning next-gen processors, enabling AI breakthroughs, orbringing leading edge products to market, every role at AMD contributes to something bigger— technologythat moves the world forward. Join us and, together, we’ll advance your career.

AI Model, Framework, and GPU Software Engineer – Agentic AI
THE ROLE:

Join a team developing AI software technologies that enable state-of-the-art models and frameworks to run efficiently on GPU-accelerated platforms. This role spans the end-to-end AI software stack—from model bring-up and framework enablement to performance optimization and GPU software acceleration—and offers the opportunity to contribute to open-source AI ecosystems supporting generative AI, agentic AI, large language models, image generation, and other emerging workloads across client, consumer, and enterprise platforms.

THE PERSON:

You are a strong software engineer with solid knowledge of AI software stacks and an interest in working across models, frameworks, and GPU acceleration. You are comfortable learning quickly in a fast-moving technical domain, solving complex problems, and collaborating with distributed teams across software, compiler, platform, and product areas. You communicate clearly, take ownership of technical challenges, and are motivated to build practical AI solutions that scale to real users.

KEY RESPONSIBILITIES:
  • Develop AI software solutions that enable efficient execution of models and frameworks on GPU-accelerated platforms.
  • Enable and optimize AI frameworks, inference stacks, and agentic AI software.
  • Bring up, analyze, and improve the performance of state-of-the-art AI models.
  • Optimize AI workloads across the software stack, from model architecture to GPU acceleration.
  • Collaborate with cross-functional teams to deliver end-to-end AI software features and capabilities.
  • Contribute to open-source AI software projects and support customer enablement efforts.
PREFERRED EXPERIENCE:
  • Experience developing software in C/C++ and/or Python on Linux and Windows platforms.
  • Strong understanding of AI/ML concepts, model architectures, and inference workflows.
  • Experience with AI frameworks and technologies such as PyTorch, vLLM, llama.cpp, or similar ecosystems.
  • Familiarity with GPU acceleration, performance optimization, compiler technologies, or low-level programming.
  • Experience analyzing and improving the performance of AI workloads and operators.
  • Open-source software development experience and interest in emerging AI technologies are a plus.
ACADEMIC CREDENTIALS:
  • Bachelor’s, Master, or PhD in Computer Science, Electrical Engineering or relevant fields preferred

Benefits offered are described: AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.

This posting is for an existing vacancy.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Model, Framework, and GPU Software Engineer – Agentic AI
AI Model, Framework, and GPU Software Engineer – Agentic AI

Advanced Micro Devices, Inc. • Markham

On-site
CAD 120,000 - 170,000
Sr. Software Development Engineer, AI Models
Sr. Software Development Engineer, AI Models

AMD • Markham

Hybrid
CAD 120,000 - 160,000
Sr. Software Development Engineer, AI Models
Sr. Software Development Engineer, AI Models

Advanced Micro Devices, Inc. • Markham

On-site
CAD 90,000 - 140,000
AMD benefits at a glance
Agentic AI / Data Engineer - DC GPU
Agentic AI / Data Engineer - DC GPU

AMD • Oro-Medonte

On-site
CAD 120,000 - 180,000
AI Systems Engineer – AI Model (Training & Inference)
AI Systems Engineer – AI Model (Training & Inference)

AMD • Markham

On-site
CAD 140,000 - 190,000
Principal Engineer - Gen AI training and inferencing
Principal Engineer - Gen AI training and inferencing

AMD • Markham

On-site
CAD 120,000 - 160,000
Comprehensive benefits package
Professional development opportunities
Software Engineer, AI & Engineering Productivity Tools
Software Engineer, AI & Engineering Productivity Tools

AMD • Markham

Hybrid
CAD 110,000 - 160,000
Benefits
Software Engineer, AI & Engineering Productivity Tools
Software Engineer, AI & Engineering Productivity Tools

Advanced Micro Devices, Inc. • Markham

Hybrid
CAD 100,000 - 150,000
AMD benefits at a glance
Hybrid work model
AI and Automation Software Engineer
AI and Automation Software Engineer

AMD • Vancouver

On-site
CAD 110,000 - 150,000
AMD Benefits
AI Platform Engineer, Silicon Design Infrastructure
AI Platform Engineer, Silicon Design Infrastructure

Advanced Micro Devices, Inc. • Markham

Hybrid
CAD 110,000 - 160,000