Software Engineer – AI Inference and Runtime Optimization

AMD; Austin (TX); On-site; USD 140,000 - 190,000; Full time

Job summary

Advanced Micro Devices, Inc. is seeking a collaborative software engineer to develop and optimize AI inference software and runtimes for AMD platforms. You will identify bottlenecks, improve latency and throughput, and validate performance while building benchmarks and regression tests.

The role requires strong C/C++ and Python skills, experience with AI frameworks, and familiarity with GPU programming and related technologies. Location includes Austin, TX or Markham, Ontario, Canada.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field.

Responsibilities

• Develop and optimize AI inference software and runtimes.
• Identify bottlenecks and improve latency, throughput, and memory efficiency.
• Integrate improvements and validate correctness and performance.
• Build benchmarks and automated regression tests.

Skills

C/C++

Python

AI frameworks

Perf profiling

GPU programming

PyTorch/ONNX/ROCm/HIP

Education

BSc or MSc in CS/CE/EE

Tools

PyTorch

ONNX Runtime

ROCm

HIP

Job description

ADVANCE YOUR CAREER. ADVANCE THE WORLD.

At AMD, we believetechnology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMDis shapingthefuture.

Whetheryou’redesigning next-gen processors, enabling AI breakthroughs, orbringing leading edge products to market, every role at AMD contributes to something bigger— technologythat moves the world forward.Join us and, together, we’ll advance your career.

THE ROLE:

Join AMD’s CG-AIM team to develop and optimize AI inference software and runtimes for AMD platforms, improving performance, efficiency, and scalability.

THE PERSON:

A collaborative engineer with strong software development, debugging, and problem-solving skills.

KEY RESPONSIBILITIES:

• Develop and optimize AI inference software and runtimes.
• Identify bottlenecks and improve latency, throughput, and memory efficiency.
• Integrate improvements and validate correctness and performance.
• Build benchmarks and automated regression tests.

PREFERRED EXPERIENCE:

• Strong C/C++ and Python programming skills.
• Experience with AI frameworks, inference runtimes, and performance profiling.
• Familiarity with GPU programming and parallel computing.
• Experience with PyTorch, ONNX Runtime, ROCm, HIP, or similar technologies.

ACADEMIC CREDENTIALS:

• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field.

LOCATION:

Austin, TX, OR Markham Ontario Canada

THIS ROLES IS NOT ELIGIBLE FOR VISA SPONSORSHIP.

Benefits offered are described: AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.

This posting is for an existing vacancy.