AI Model, Framework, and GPU Software Engineer – Agentic AI

Advanced Micro Devices, Inc.; Markham; On-site; CAD 120,000 - 170,000; Full time

Job summary

Advanced Micro Devices, Inc. in Markham, Ontario seeks an AI Model, Framework, and GPU Software Engineer – Agentic AI to advance state-of-the-art AI software on GPU-accelerated systems.

You will contribute across the full stack—from model bring-up to performance optimization and GPU acceleration—supporting generative AI workloads for diverse platforms. The role requires strong C/C++ and Python, Linux/Windows proficiency, and experience with PyTorch, vLLM, llama.cpp, or similar ecosystems.

Qualifications

• Bachelor’s, Master, or PhD in Computer Science, Electrical Engineering or relevant fields preferred.
• Strong knowledge of AI software stacks and experience with model architectures and inference workflows.
• Experience with AI frameworks and technologies such as PyTorch, vLLM, llama.cpp, or similar ecosystems.

Responsibilities

• Develop AI software solutions that enable efficient execution of models and frameworks on GPU-accelerated platforms.
• Enable and optimize AI frameworks, inference stacks, and agentic AI software.
• Bring up, analyze, and improve the performance of state-of-the-art AI models.
• Optimize AI workloads across the software stack, from model architecture to GPU acceleration.
• Collaborate with cross-functional teams to deliver end-to-end AI software features and capabilities.
• Contribute to open-source AI software projects and support customer enablement efforts.

Skills

C/C++

Python

Linux

Windows

PyTorch

vLLM

llama.cpp

GPU acceleration

Open-source

Education

Bachelor’s, Master, or PhD in Computer Science or Electrical Engineering

Tools

CUDA

Compiler toolchains

Job description

ADVANCE YOUR CAREER. ADVANCE THE WORLD.

At AMD, we believetechnology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMDis shapingthefuture.

Whetheryou’redesigning next-gen processors, enabling AI breakthroughs, orbring leading edge products to market, every role at AMD contributes to something bigger— technologythat moves the world forward.Join us and, together, we’ll advance your career.

AI Model, Framework, and GPU Software Engineer – Agentic AI

THE ROLE:

Join a team developing AI software technologies that enable state-of-the-art models and frameworks to run efficiently on GPU-accelerated platforms. This role spans the end-to-end AI software stack—from model bring-up and framework enablement to performance optimization and GPU software acceleration—and offers the opportunity to contribute to open-source AI ecosystems supporting generative AI, agentic AI, large language models, image generation, and other emerging workloads across client, consumer, and enterprise platforms.

THE PERSON:

You are a strong software engineer with solid knowledge of AI software stacks and an interest in working across models, frameworks, and GPU acceleration. You are comfortable learning quickly in a fast-moving technical domain, solving complex problems, and collaborating with distributed teams across software, compiler, platform, and product areas. You communicate clearly, take ownership of technical challenges, and are motivated to build practical AI solutions that scale to real users.

KEY RESPONSIBILITIES:

• Develop AI software solutions that enable efficient execution of models and frameworks on GPU-accelerated platforms.
• Enable and optimize AI frameworks, inference stacks, and agentic AI software.
• Bring up, analyze, and improve the performance of state-of-the-­art AI models.
• Optimize AI workloads across the software stack, from model architecture to GPU acceleration.
• Collaborate with cross-functional teams to deliver end‑to‑end AI software features and capabilities.
• Contribute to open-source AI software projects and support customer enablement efforts.

PREFERRED EXPERIENCE:

• Experience developing software in C/C++ and/or Python on Linux and Windows platforms.
• Strong understanding of AI/ML concepts, model architectures, and inference workflows.
• Experience with AI frameworks and technologies such as PyTorch, vLLM, llama.cpp, or similar ecosystems.
• Familiarity with GPU acceleration, performance optimization, compiler technologies, or low‑level programming.
• Experience analyzing and improving the performance of AI workloads and operators.
• Open-source software development experience and interest in emerging AI technologies are a plus.

ACADEMIC CREDENTIALS:

• Bachelor’s, Master, or PhD in Computer Science, Electrical Engineering or relevant fields preferred

Benefits offered are described: AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third‑party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.

This posting is for an existing vacancy.