Principal Software Development Engineer

Advanced Micro Devices; Markham; Hybrid; CAD 120,000 - 150,000; Full time

Job summary

A major technology company is seeking a Principal Software Development Engineer based in Markham, Ontario. The ideal candidate will enhance Generative AI training and inference at scale, collaborate on cutting-edge technologies, and bring deep technical expertise in AI models. The role involves implementing efficient architectures on AMD devices and working with industry specialists. This position offers a hybrid work environment and opportunities for innovation in AI applications.

Qualifications

• Strong technical expertise in Gen AI model training and inference.
• Experience productizing generative AI models at scale.
• Several years in AI and deep learning software development.

Responsibilities

• Propose innovative techniques for training and inference.
• Implement architectures for Generative AI models on AMD devices.
• Collaborate with software and hardware teams for performance optimization.

Skills

Deep understanding of generative AI applications

Experience with large language models (LLMs)

Experience with deep learning frameworks like PyTorch/JAX

Excellent communication skills

Education

PhD or master's degree in Computer Science, Electrical Engineering, Mathematics, or related field

Tools

PyTorch

JAX

Hugging Face

Job description

Overview

WHAT YOU DO AT AMD CHANGES EVERYTHING

At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond. Together, we advance your career.

Position: Principal Software Development Engineer

The Role

The AI Models and Applications team at AMD is looking for a specialized Principal level engineer who is passionate about enabling innovative and efficient Generative AI training and inference at scale. You will be part of a core team of talented specialists and work on scaling training and inference for the latest Generative AI models.

The Person

The ideal candidate has deep technical understanding of the latest generative AI applications like large language models (LLMs), large multimodal models (LMMs), image/video generation, has experience training models at scale and is passionate about innovating efficient approaches to enable distributed training and inference at scale on AMD devices.

Why Join Us?

• Exciting Opportunities: You will be at the forefront of innovation, working with the latest Gen AI models and algorithms. Shape the future of AI model training and inference optimizations across a variety of applications.
• Talented Team: Collaborate with highly skilled industry specialists and learn from the best in the field.
• Cutting-edge Technology: Work with state-of-the-art GenAI algorithms and software to stay ahead and drive advancements in AI model training at scale and deployment.
• Impactful Work: Your contributions will influence how cutting-edge Gen AI models are trained at scale and inferencing deployed to serve millions of customers.

Key Responsibilities

• Propose and apply innovative techniques to support both training and inference, including transformer architectures and parallelism strategies to train on large clusters with low-precision training.
• Implement novel efficient architectures for Generative AI models for training and inference and demonstrate benefits on AMD devices.
• Work with open-source frameworks and communities (e.g., PyTorch, JAX, Hugging Face) to integrate AMD-optimized models, libraries and publish training recipes.
• Collaborate with software and hardware teams to co-optimize performance on current and future AMD solutions.
• Publish and promote your work within AMD and at external venues.

Preferred Experience

• Strong technical expertise in Gen AI model training and inference, and familiarity with deep learning frameworks like PyTorch/JAX.
• Strong technical expertise in algorithmic innovation toward efficient Gen AI applications for both training and inference.
• Publications in areas such as efficient model architectures, optimized training, innovative parallelism strategies, or low-precision training are a plus.
• Publications in conferences such as NeurIPS, CVPR, ECCV/ICCV, ICML, ICLR are a plus.
• Experience productizing generative AI models and training foundation models at scale.
• Excellent written, verbal, and presentation skills; ability to coordinate internally and externally.
• Several years of experience in AI, deep learning and related software development.

Academic Credentials

PhD or master’s degree or higher, with a major in CS, EE, Mathematics, or a related field.

Location

Markham, Ontario, Canada (Hybrid).

Can also consider Calgary, Alberta, Canada.

#LI-MV1

#HYBRID

Benefits and Policies

Benefits offered are described: AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.

This posting is for an existing vacancy.