Principal Software Development Engineer – Compiler & ML Acceleration

AMD; San Jose (CA); On-site; USD 240,000 - 360,000; Full time

Job summary

AMD is seeking a Principal Software Development Engineer to lead compiler technology, MLIR-based infrastructure, and model-to-hardware optimization for AI workloads. You will shape scalable compiler pipelines and collaborate with hardware and software teams.

The role sits at the intersection of compiler development, ML frameworks, and accelerated ML execution on NPUs and specialized compute engines. We value strong C++ skills, production experience, and the ability to influence architecture

Qualifications

• Experience in compiler development across front-end/middle-end/back-end and code optimization.
• Hands-on experience with MLIR and/or LLVM-based compiler infrastructure.
• Proven experience working on neural network workloads.
• Deep understanding of graph-level and compiler-level optimizations for ML models.

Responsibilities

• Lead architecture design and development of compiler components and optimization pipelines for machine learning.
• Design and implement MLIR-based compiler flows to lower high-level ML representations into highly optimized hardware-specific code.
• Drive model compilation and data movement optimization for ML inference workloads.
• Define and implement compiler strategies for operator fusion, memory planning, scheduling, and performance optimization.
• Work cross-functionally with hardware, runtime, frontend, and systems teams to align compiler capabilities with evolving accelerator architectures.
• Provide technical leadership and mentorship, influencing compiler direction and best practices across the organization.

Skills

Compiler development

MLIR/LLVM

C++

Neural networks

NPUs/AI accelerators

ML model optimization

Production ML infra

Graph-level optimization

Education

Bachelor’s or Master’s degree in Computer Science/Computer Engineering/Electrical Engineering or equivalent

Tools

MLIR/LLVM-based compiler infrastructure

Job description

WHAT YOU DO AT AMD CHANGES EVERYTHING

At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond.

Together, we advance your career.

The Role

AMD is building the next generation of compiler and software infrastructure to accelerate Large Language Models (LLMs) and ML workloads on emerging accelerator architectures.

WHAT YOU DO AT AMD CHANGES EVERYTHING

At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond.

Together, we advance your career.

The Role

AMD is building the next generation of compiler and software infrastructure to accelerate Large Language Models (LLMs) and ML workloads on emerging accelerator architectures.

The Person

We are looking for a Principal Software Development Engineer to lead technical development in compiler technology, MLIR-based infrastructure, and model-to-hardware optimization, with a strong focus on enabling high-performance execution for AI workloads.

This role sits at the intersection of compiler development, ML frameworks, and AI model execution, supporting advanced acceleration pipelines targeting NPUs and other specialized compute engines.

Key Responsibilities

• Lead architecture design and development of compiler components and optimization pipelines for machine learning


• Design and implement MLIR-based compiler flows to lower high-level ML representations into highly optimized hardware-specific code


• Drive model compilation and data movement optimization for ML inference workloads


• Define and implement compiler strategies for operator fusion, memory planning, scheduling, and performance optimization


• Work cross-functionally with hardware, runtime, frontend, and systems teams to align compiler capabilities with evolving accelerator architectures


• Provide technical leadership and mentorship, influencing compiler direction and best practices across the organization


• Contribute to long-term roadmap decisions for compiler and ML acceleration software

Preferred Experience

• Strong experience in compiler development (front-end, middle-end, and/or back-end) and code optimization


• Hands-on expertise with MLIR and/or LLVM-based compiler infrastructure


• Proven experience working on neural network workloads


• Deep understanding of graph-level and compiler-level optimizations for ML models


• Strong C++ development skills and experience working in large, complex codebases


• Ability to operate at Principal-level technical scope, influencing architecture and direction beyond individual deliverables


• Experience targeting or optimizing for NPUs or specialized AI accelerators


• Familiarity with model compilation stacks and custom lowering pipelines


• Contributions to compiler or ML infrastructure in production environments

Academic Credentials

Bachelor’s or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent

This role is not eligible for visa sponsorship.

Benefits offered are described: AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.

This posting is for an existing vacancy.