Principal AI Software Engineer

Advanced Micro Devices; San Jose (CA); On-site; USD 150,000 - 200,000; Full time

Benefits offered by this job

AMD benefits at a glance

Job summary

A leading technology company is looking for a technical leader for the ROCm software group in San Jose. You will drive innovation and develop next-generation products across AI workloads. The ideal candidate will work across organizations, influence software architecture, and deliver high-performance solutions for AMD's product lines. The position requires deep expertise in AI/ML frameworks and collaboration across hardware/software teams. Candidates must have at least a Bachelor's degree in a relevant field.

Qualifications

• Deep expertise in AI/ML software stack across compilers, kernels, and libraries.
• Experience with GPU architectures and programming frameworks like ROCm or CUDA.
• Strong collaboration abilities across organizations.

Responsibilities

• Drive innovation in ROCm software for new product initiatives.
• Collaborate on hardware/software co-design to maximize performance.
• Lead performance engineering for large-scale AI models.

Skills

Technical leadership

Hardware/software co-design

AI/ML frameworks knowledge

GPU programming

Education

Bachelor of Science in Electrical Engineering or Computer Science

Job description

THE ROLE:

AMD AI Group is seeking a highly influential technical leader in the ROCm software for New Product Initiatives. This role requires driving innovation and developing next‑generation products across AMD’s broad portfolio, serving Instinct, Radeon, Ryzen, Embedded, Gaming and Autonomous Driving product lines.

The ideal candidate will shape the end‑to‑end ROCm software and influence the full stack spanning compilers, kernels, runtime, libraries, models, frameworks, and performance optimization layers. A key expectation is strong hardware/software co‑design leadership to maximize performance, efficiency, scalability, and programmability across diverse AMD products and workloads.

THE PERSON:

You are a strong technical leader who can work across organizations, align architecture with product goals, and influence innovation and execution. You bring deep expertise in at least one major area of the stack and demonstrate the curiosity, adaptability, and technical breadth to learn new domains, grow your impact, and influence the broader ecosystem.

As a successful candidate, you are recognized for technical excellence and the ability to deliver innovations through collaboration across silicon, system software, AI/ML frameworks, libraries, and application enablement teams.

KEY RESPONSIBILITIES:

• Hardware‑Software Co‑design – Collaborate across hardware architecture, compiler, math libraries, kernel, and framework teams to influence future silicon features based on evolving AI workload trends.
• Strong Execution – Deliver innovations and roadmap for AI software stack across all AMD products, ensuring AMD remains the platform of choice for top‑tier AI customers.
• Workload Performance Engineering – Lead the profiling, analysis, and tuning of large‑scale models (LLMs, Diffusion, Multimodal, and MoE) to ensure “out‑of‑the‑box” performance excellence on AMD hardware.
• Ecosystem Innovation – Drive the development of advanced tools and frameworks for performance estimation, modeling, and automated reporting.
• Customer Engagement – Partner with top customers and hyperscalers to understand their unique workload requirements and deliver tailored architectural wins and software optimizations.
• Community & Open Source – Mentor and inspire other engineers and contribute to ROCm Open‑source.

PREFERRED EXPERIENCE:

• Knowledge in GPU architectures, basic knowledge of CPU architecture.
• Experience in AI/ML software stack spanning compilers, kernels, runtime, libraries, models, frameworks, and performance optimization layers.
• Understanding of GPU programming such as ROCm, CUDA, OpenCL, etc.
• Experience in hardware/software co‑design, building high‑performance products across the full product lifecycle.
• Experience with operating systems (OS) and device driver development is a plus.

ACADEMIC CREDENTIALS:

• Undergrad degree required.
• Bachelor of Science, Master’s, or PhD degree with emphasis in Electrical Engineering, Computer Architecture, or Computer Science with relevant experience preferred.

LOCATION:

• San Jose, other locations will be considered.

BENEFITS:

Benefits offered are described: AMD benefits at a glance.

EEO STATEMENT:

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee‑based recruitment services. AMD and its subsidiaries are equal‑opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third‑party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.

This posting is for an existing vacancy.