AI Power & Performance Engineer

Advanced Micro Devices, Inc; Bengaluru; On-site; INR 450,000 - 650,000; Full time

Job summary

Advanced Micro Devices, Inc. in Bengaluru seeks an experienced AI Power & Performance Engineer to benchmark, profile, and optimize AI inference workloads across CPU, GPU, APU, and heterogeneous platforms.

You will evaluate latency, throughput, memory, and power, and drive optimizations and actionable recommendations. The role requires strong Linux expertise, hands-on benchmarking with PyTorch/ONNX/TensorFlow, and collaboration with cross-functional teams to improve software and hardware

Qualifications

• 5 to 10 years of relevant experience in AI performance engineering, system performance analysis, workload optimization, or benchmarking.
• Hands-on experience benchmarking AI inference workloads on CPU, GPU, APU, or NPU platforms.
• Strong experience with PyTorch, ONNX Runtime, vLLM, llama.cpp, TensorFlow, or similar frameworks and runtimes.
• Strong Linux expertise with performance profiling, workload tracing, automation, and system-level debugging.
• Experience with profiling tools such as Linux perf, AMD uProf, ROCm Profiler, Nsight Systems, VTune, Perfetto, or equivalent tools.
• Good understanding of CPU/GPU architecture, memory hierarchy, power and thermal behavior, and performance trade-offs.
• Proficiency in Python and Bash for automation, data analysis, and reporting.
• Ability to communicate complex performance data through clear technical reports, dashboards, and recommendations.

Responsibilities

• Benchmark and characterize AI inference workloads using PyTorch, ONNX Runtime, vLLM, llama.cpp, TensorFlow, and related technologies.
• Analyze latency, throughput, memory utilization, power consumption, and performance per watt.
• Profile workloads and identify bottlenecks across AI frameworks, runtimes, operating systems, memory subsystems, and hardware.
• Optimize workload performance through quantization, graph optimization, kernel tuning, memory optimization, and heterogeneous compute utilization.
• Conduct competitive benchmarking across AMD and competing CPU, GPU, APU, and AI accelerator platforms.
• Automate benchmark execution, data collection, regression analysis, and results visualization.
• Convert benchmarking results into actionable recommendations for software, hardware, product, and business teams.
• Collaborate with architects, framework, runtime, driver, firmware, and system software teams to resolve performance issues.

Skills

AI performance

Linux profiling

PyTorch

ONNX Runtime

vLLM

llama.cpp

TensorFlow

Python

Bash

Data analysis

Reporting

Education

Bachelor's degree

Tools

Linux perf

uProf

ROCm Profiler

Nsight Systems

VTune

Perfetto

Job description

ADVANCE YOUR CAREER. ADVANCE THE WORLD.

At AMD, we believetechnology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMDis shapingthefuture.

Whetheryou’redesigning next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger— technologythat moves the world forward.Join us and, together, we’ll advance your career.

AI Power & Performance Engineer

Role Overview

We are seeking an experienced AI Power & Performance Engineer to join our AI System PnP team. The candidate will evaluate, benchmark, profile, and optimize AI inference workloads across modern CPU, GPU, APU, and heterogeneous computing platforms.

Key Responsibilities

• Benchmark and characterize AI inference workloads using PyTorch, ONNX Runtime, vLLM, llama.cpp, TensorFlow, and related technologies.
• Analyze latency, throughput, memory utilization, power consumption, and performance per watt.
• Profile workloads and identify bottlenecks across AI frameworks, runtimes, operating systems, memory subsystems, and hardware.
• Optimize workload performance through quantization, graph optimization, kernel tuning, memory optimization, and heterogeneous compute utilization.
• Conduct competitive benchmarking across AMD and competing CPU, GPU, APU, and AI accelerator platforms.
• Automate benchmark execution, data collection, regression analysis, and results visualization.
• Convert benchmarking results into actionable recommendations for software, hardware, product, and business teams.
• Collaborate with architects, framework, runtime, driver, firmware, and system software teams to resolve performance issues.

Required Skills & Experience

• 5 to 10 years of relevant experience in AI performance engineering, system performance analysis, workload optimization, or benchmarking.
• Hands-on experience benchmarking AI inference workloads on CPU, GPU, APU, or NPU platforms.
• Strong experience with PyTorch, ONNX Runtime, vLLM, llama.cpp, TensorFlow, or similar frameworks and runtimes.
• Strong Linux expertise with experience in performance profiling, workload tracing, automation, and system-level debugging.
• Experience with profiling tools such as Linux perf, AMD uProf, ROCm Profiler, Nsight Systems, VTune, Perfetto, or equivalent tools.
• Good understanding of CPU/GPU architecture, memory hierarchy, power and thermal behavior, and performance trade-offs.
• Proficiency in Python and Bash for automation, data analysis, and reporting.
• Ability to communicate complex performance data through clear technical reports, dashboards, and recommendations.

Preferred Qualifications

• Experience with ROCm, Ryzen AI Software, Vitis AI, MIGraphX, or related AI technologies.
• Knowledge of model quantization, mixed-precision inference, graph optimization, and LLM-serving techniques.
• Experience with MLPerf Inference, competitive benchmarking, Docker, virtualization, or post-silicon performance validation.

Education

Bachelor’s or master’s degree in Computer Engineering, Electrical Engineering, Computer Science, Artificial Intelligence, Machine Learning, or a related field.

#LI-PK1

Benefits offered are described: AMD benefits at a glance.

AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.

This posting is for an existing vacancy.