Software Engineer – AI Inference and Performance Optimization

Advanced Micro Devices, Inc.

Austin (TX)

On-site

USD 140,000 - 200,000

Full time

8 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AMD seeks a collaborative software engineer to develop and optimize AI inference software for AMD platforms. You will work with architecture and software teams to improve performance, efficiency, and scalability across AI workloads.

Join us to turn performance analysis into practical improvements, build benchmarks and automated tests, and contribute to cutting-edge AI technologies across GPUs and heterogeneous compute.

Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
  • Strong C/C++ and Python development skills.
  • Experience with AI frameworks, inference runtimes, and performance profiling.
  • Familiarity with GPU programming, parallel computing, and memory optimization.

Responsibilities

  • Develop and optimize AI inference software, runtimes, and workloads.
  • Identify bottlenecks and improve latency, throughput, and memory efficiency.
  • Integrate and validate improvements with architecture and software teams.
  • Build benchmarks and automated tests to track performance and correctness.

Skills

C/C++
Python
Performance profiling
GPU programming

Education

Bachelor’s or Master’s degree in CS/CE/EE

Tools

PyTorch
ONNX Runtime
ROCm
HIP

Job description

ADVANCE YOUR CAREER. ADVANCE THE WORLD.

At AMD, we believetechnology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMDis shapingthefuture.

Whetheryou’redesigning next-gen processors, enabling AI breakthroughs, orbringing leading edge products to market, every role at AMD contributes to something bigger— technologythat moves the world forward.Join us and, together, we’ll advance your career.

THE ROLE:

Join AMD’s CG-AIM team to develop and optimize AI inference software for AMD platforms. Work with architecture and engineering teams to improve performance, efficiency, and scalability across AI workloads.

THE PERSON:

A collaborative engineer with strong software development, debugging, and problem-solving skills who can turn performance analysis into practical improvements.

KEY RESPONSIBILITIES:
  • Develop and optimize AI inference software, runtimes, and workloads.
  • Identify bottlenecks and improve latency, throughput, and memory efficiency.
  • Integrate and validate improvements with architecture and software teams.
  • Build benchmarks and automated tests to track performance and correctness.
PREFERRED EXPERIENCE:
  • Strong C/C++ and Python development skills.
  • Experience with AI frameworks, inference runtimes, and performance profiling.
  • Familiarity with GPU programming, parallel computing, and memory optimization.
  • Experience with PyTorch, ONNX Runtime, ROCm, HIP, or similar technologies.
ACADEMIC CREDENTIALS:
  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
LOCATION:

Austin, TX, OR Markham Ontario Canada

THIS ROLE IS NOT ELIGIBLE FOR VISA SPONSORSHIP

#LI-AG1

Benefits offered are described: AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.

This posting is for an existing vacancy.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer – AI Inference Integration and Optimization
Software Engineer – AI Inference Integration and Optimization

Advanced Micro Devices, Inc. • Austin (TX)

On-site
USD 120,000 - 180,000
Software Development Engineer - AI Workload Optimization
Software Development Engineer - AI Workload Optimization

Advanced Micro Devices, Inc • Austin (TX)

On-site
USD 180,000 - 280,000
Datacenter and AI Infrastructure Silicon Performance Architect
Datacenter and AI Infrastructure Silicon Performance Architect

Advanced Micro Devices, Inc. • Austin (TX)

On-site
USD 140,000 - 180,000
Competitive benefits package
Senior AI Performance Engineer - Systems & Benchmarking
Senior AI Performance Engineer - Systems & Benchmarking

Advanced Micro Devices, Inc. • Austin (TX)

Hybrid
USD 140,000 - 240,000
AI Systems Performance Engineer
AI Systems Performance Engineer

Advanced Micro Devices, Inc. • Austin (TX)

On-site
USD 120,000 - 180,000
Gen AI Software Development Engineer
Gen AI Software Development Engineer

Advanced Micro Devices, Inc • Santa Clara (CA)

On-site
USD 180,000 - 260,000
Senior GPU Performance Software Engineer
Senior GPU Performance Software Engineer

Advanced Micro Devices, Inc. • Austin (TX)

On-site
USD 150,000 - 230,000
Software Development Engineer - AI Workload Optimization
Software Development Engineer - AI Workload Optimization

Digitailor • Seattle (WA)

On-site
USD 200,000 - 260,000
AI/ML SW/HW CO-Design Lead
AI/ML SW/HW CO-Design Lead

Advanced Micro Devices, Inc • San Jose (CA)

On-site
USD 180,000 - 260,000
Sr Principal AI Performance Software Architect
Sr Principal AI Performance Software Architect

Advanced Micro Devices, Inc. • Santa Clara (CA)

On-site
USD 120,000 - 160,000
Comprehensive benefits package
Inclusive culture
Career advancement opportunities