Principal Software Development Engineer - Compiler & ML Acceleration

Advanced Micro Devices; San Jose (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

AMD is seeking a Principal Software Development Engineer to lead compiler technology and MLIR-based infrastructure for AI workloads on specialized accelerators. You will steer model-to-hardware optimization, enabling high-performance execution across NPUs and other compute engines.

The role sits at the intersection of compiler development, ML frameworks, and AI model execution, requiring broad cross-functional collaboration and technical leadership to shape accelerator software roadmaps.

Qualifications

• Strong background in compiler development spanning front-end, middle-end, and/or back-end
• Hands-on experience with MLIR/LLVM-based infrastructure and high-performance ML workloads
• Proven ability to optimize neural network models and graphs for accelerator hardware

Responsibilities

• Lead architecture design and development of compiler components and optimization pipelines for ML
• Design and implement MLIR-based compiler flows to lower ML representations to hardware-specific code
• Drive model compilation and data movement optimization for ML inference workloads
• Define and implement strategies for operator fusion, memory planning, scheduling, and performance optimization
• Collaborate cross-functionally with hardware, runtime, frontend, and systems teams to align compiler capabilities with accelerator architectures
• Provide technical leadership and mentorship influencing compiler direction and best practices

Skills

Compiler development

MLIR/LLVM

C++ development

Neural network workloads

Graph-level optimizations

Leadership

Education

Bachelor’s or Master’s degree in CS/CE/EE

Tools

MLIR

LLVM

Job description

WHAT YOU DO AT AMD CHANGES EVERYTHING

At AMD, our mission is to build great products that accelerate next‑generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond.

THE ROLE:

AMD is building the next generation of compiler and software infrastructure to accelerate Large Language Models (LLMs) and ML workloads on emerging accelerator architectures.

THE PERSON:

We are looking for a Principal Software Development Engineer to lead technical development in compiler technology, MLIR‑based infrastructure, and model‑to‑hardware optimization, with a strong focus on enabling high‑performance execution for AI workloads.

This role sits at the intersection of compiler development, ML frameworks, and AI model execution, supporting advanced acceleration pipelines targeting NPUs and other specialized compute engines.

KEY RESPONSIBILITIES:

• Lead architecture design and development of compiler components and optimization pipelines for machine learning
• Design and implement MLIR‑based compiler flows to lower high‑level ML representations into highly optimized hardware‑specific code
• Drive model compilation and data movement optimization for ML inference workloads
• Define and implement compiler strategies for operator fusion, memory planning, scheduling, and performance optimization
• Work cross‑functionally with hardware, runtime, frontend, and systems teams to align compiler capabilities with evolving accelerator architectures
• Provide technical leadership and mentorship, influencing compiler direction and best practices across the organization
• Contribute to long‑term roadmap decisions for compiler and ML acceleration software

PREFERRED EXPERIENCE:

• Strong experience in compiler development (front‑end, middle‑end, and/or back‑end) and code optimization
• Hands‑on expertise with MLIR and/or LLVM‑based compiler infrastructure
• Proven experience working on neural network workloads
• Deep understanding of graph‑level and compiler‑level optimizations for ML models
• Strong C++ development skills and experience working in large, complex codebases
• Ability to operate at Principal‑level technical scope, influencing architecture and direction beyond individual deliverables
• Experience targeting or optimizing for NPUs or specialized AI accelerators
• Familiarity with model compilation stacks and custom lowering pipelines
• Contributions to compiler or ML infrastructure in production environments

ACADEMIC CREDENTIALS:

Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent

This role is not eligible for visa sponsorship.

AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third‑party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

This posting is for an existing vacancy.