Sr. AI/ML Software System Design Engineer

Advanced Micro Devices; Markham; On-site; CAD 60,000 - 80,000; Full time

Job summary

A leading semiconductor company located in York Region, Markham is seeking a Sr. AI/ML Engineer to lead the design and implementation of advanced AI architectures. The role involves defining AI strategies, collaborating with various teams to optimize AI workloads, and developing frameworks that enhance validation cycles. Preferred candidates will possess a strong background in AI frameworks, experience with GPU computing, and proficiency in C/C++ and Python. This position offers a dynamic work environment focused on innovation and collaboration.

Qualifications

• Strong background in AI/ML frameworks such as PyTorch, TensorFlow, and ONNX.
• Experience with GPU computing and ROCm software stack.
• Knowledge of distributed systems and performance optimization.
• Proficiency in C/C++, Python, and Linux environments.
• Familiarity with networking technologies for high-performance data transfer.
• Excellent communication and problem-solving skills.
• Proven delivery of complex AI solutions.

Responsibilities

• Define and drive AI architecture strategies for GPU-based platforms.
• Collaborate with teams to optimize AI/ML workloads.
• Develop AI-driven frameworks for automated testing.
• Lead architectural reviews and design decisions.
• Create reference designs for AI workloads.
• Drive automation strategies for AI solutions.
• Partner with customers for end-to-end AI solutions.
• Mentor junior engineers and foster innovation.

Skills

AI/ML frameworks (PyTorch, TensorFlow, ONNX)

GPU computing

C/C++, Python

Linux environments

Networking technologies (RDMA, RoCE)

Leadership skills

Problem-solving skills

Education

Bachelor’s or Master’s degree in Computer or Electrical Engineering

Tools

HIP

MIGraphX

rocBLAS

MIOpen

Job description

WHAT YOU DO AT AMD CHANGES EVERYTHING

At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond.

THE ROLE:

As a Sr. AI/ML Engineer, you will lead the design and implementation of advanced AI/ML architectures across AMD’s GPU and data center platforms. This global technical leadership role focuses on defining strategies for AI-driven validation methodologies, ensuring robust system performance, scalability, and reliability. You will collaborate across silicon, firmware, hardware, and software teams to deliver optimized AI solutions for next-generation computing experiences.

THE PERSON:

You are passionate about AI/ML technologies and system architecture, with a strong ability to innovate and solve complex technical challenges. You thrive in a collaborative environment, influencing cross-functional teams and driving architectural decisions that shape the future of AI computing. Your curiosity and leadership will enable continuous improvement and excellence in AMD’s AI solutions.

KEY RESPONSIBILITIES:

• Define and drive AI architecture strategies for GPU-based platforms and distributed systems.
• Collaborate with engineering teams to design and optimize AI/ML workloads for performance, scalability, and efficiency, while architecting AI/ML solutions that integrate into innovative validation methodologies for driver code and hardware.
• Develop AI-driven frameworks for automated testing, predictive analytics, and intelligent bug triage to accelerate validation cycles.
• Lead architectural reviews and provide guidance on design decisions for AI frameworks, drivers, and system integration.
• Create reference designs and benchmarks for AI workloads, ensuring alignment with industry standards.
• Drive automation and validation strategies for AI solutions, including cluster-scale deployments.
• Partner with customers and internal teams to deliver end-to-end AI solutions for data centers and edge platforms.
• Mentor junior engineers and foster technical innovation across teams.
• Provide regular updates on architectural progress and influence roadmap decisions.

PREFERRED EXPERIENCE:

• Strong background in AI/ML frameworks such as PyTorch, TensorFlow, ONNX Runtime, and familiarity with Hugging Face for model fine-tuning and deployment.
• Experience with GPU computing and ROCm software stack, including libraries like MIGraphX, rocBLAS, and MIOpen.
• Knowledge of distributed systems and performance optimization for AI workloads.
• Proficiency in C/C++, Python, and Linux environments; experience with HIP for GPU programming.
• Familiarity with networking technologies such as RDMA and RoCE for high‑performance data transfer in cluster environments.
• Excellent communication, leadership, and problem‑solving skills.
• Proven track record of delivering complex, multi‑functional AI solutions in fast‑paced environments.

ACADEMIC CREDENTIALS:

• Bachelor’s or Master’s degree in Computer or Electrical Engineering or equivalent

Benefits offered are described:

AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee‑based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third‑party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.