Software Engineer – AI Inference Integration and Optimization

AMD; Austin (TX); On-site; USD 120,000 - 180,000; Full time

Job summary

Advanced Micro Devices, Inc. seeks a collaborative software engineer to join the CG-AIM team in Austin, TX or Markham, Ontario. You will develop, integrate, and optimize AI inference software for AMD platforms, contributing to high-performance computing and AI workloads.

You should have strong C/C++ and Python, experience with AI frameworks, and a passion for debugging and performance. This role emphasizes delivering efficient, scalable inference solutions and building automated tests.

Qualifications

• C/C++ and Python programming required.
• Familiarity with AI frameworks and inference runtimes.
• Experience with software profiling, testing, and debugging.

Responsibilities

• Develop and integrate AI inference software.
• Debug functional and performance issues.
• Optimize workloads for latency, throughput, and memory efficiency.
• Build automated tests and performance benchmarks.

Skills

C/C++

Python

Debugging

Profiling

Performance optimization

Problem solving

Education

Bachelor's or Master’s in CS/CE/EE

Tools

PyTorch

ONNX Runtime

ROCm

HIP

GPU programming

Job description

ADVANCE YOUR CAREER. ADVANCE THE WORLD. At AMD, we believe technology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMD is shaping the future.

ADVANCE YOUR CAREER. ADVANCE THE WORLD. At AMD, we believe technology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMD is shaping the future.

Whether you’re designing next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger — technology that moves the world forward. Join us and, together, we’ll advance your career.

The Role

Join AMD’s CG-AIM team to develop, integrate, and optimize AI inference software for AMD platforms.

The Person

A collaborative engineer with strong programming, debugging, and problem-solving skills who enjoys learning and improving software performance.

Key Responsibilities

• Develop and integrate AI inference software.
• Debug functional and performance issues.
• Optimize workloads for latency, throughput, and memory efficiency.
• Build automated tests and performance benchmarks.

Preferred Experience

• C/C++ and Python programming.
• Familiarity with AI frameworks and inference runtimes.
• Experience with software profiling, testing, and debugging.
• Exposure to PyTorch, ONNX Runtime, ROCm, HIP, or GPU programming.

Academic Credentials

• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field.

LOCATION

Austin, TX, OR Markham Ontario Canada

THIS ROLE IS NOT ELIGIBLE FOR VISA SPONSORSHIP

Benefits offered are described: AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.

This posting is for an existing vacancy.