AI Power & Performance Engineer

Advanced Micro Devices, Inc.; Bengaluru; On-site; INR 4,000,000 - 8,000,000; Full time

Job summary

Advanced Micro Devices, Inc. seeks an experienced AI Power & Performance Engineer to evaluate, benchmark, profile, and optimize AI inference workloads across CPU, GPU, APU, and heterogeneous platforms.

You will drive performance improvements and provide actionable recommendations to software, hardware, product, and business teams. The role requires strong Linux profiling skills, proficiency in Python and Bash, and hands-on benchmarking with PyTorch, ONNX Runtime, vLLM, and TensorFlow.

Qualifications

• 5 to 10 years of relevant experience in AI performance engineering, system performance analysis, workload optimization, or benchmarking.
• Hands-on experience benchmarking AI inference workloads on CPU, GPU, APU, or NPU platforms.
• Strong experience with PyTorch, ONNX Runtime, vLLM, llama.cpp, TensorFlow, or similar frameworks and runtimes.
• Strong Linux expertise with performance profiling, workload tracing, automation, and system-level debugging.
• Experience with profiling tools such as Linux perf, AMD uProf, ROCm Profiler, Nsight Systems, VTune, Perfetto, or equivalent tools.
• Good understanding of CPU/GPU architecture, memory hierarchy, power and thermal behavior, and performance trade-offs.
• Proficiency in Python and Bash for automation, data analysis, and reporting.
• Ability to communicate complex performance data through clear technical reports, dashboards, and recommendations.

Responsibilities

• Benchmark and characterize AI inference workloads using PyTorch, ONNX Runtime, vLLM, llama.cpp, TensorFlow, and related technologies.
• Analyze latency, throughput, memory utilization, power consumption, and performance per watt.
• Profile workloads and identify bottlenecks across AI frameworks, runtimes, operating systems, memory subsystems, and hardware.
• Optimize workload performance through quantization, graph optimization, kernel tuning, memory optimization, and heterogeneous compute utilization.
• Conduct competitive benchmarking across AMD and competing CPU, GPU, APU, and AI accelerator platforms.
• Automate benchmark execution, data collection, regression analysis, and results visualization.
• Convert benchmarking results into actionable recommendations for software, hardware, product, and business teams.
• Collaborate with architects, framework, runtime, driver, firmware, or system software teams to resolve performance issues.

Skills

AI performance engineering

System performance analysis

Workload optimization

Benchmarking

Linux profiling

Python

Bash scripting

Reporting dashboards

Education

Bachelor's or Master’s degree in CS/EE/CE/AI/ML

Tools

Linux perf

AMD uProf

ROCm Profiler

Nsight Systems

VTune

Perfetto

Job description

AI Power & Performance Engineer

We are seeking an experienced AI Power & Performance Engineer to join our AI System PnP team. The candidate will evaluate, benchmark, profile, and optimize AI inference workloads across modern CPU, GPU, APU, and heterogeneous computing platforms.

Key Responsibilities

• Benchmark and characterize AI inference workloads using PyTorch, ONNX Runtime, vLLM, llama.cpp, TensorFlow, and related technologies.
• Analyze latency, throughput, memory utilization, power consumption, and performance per watt.
• Profile workloads and identify bottlenecks across AI frameworks, runtimes, operating systems, memory subsystems, and hardware.
• Optimize workload performance through quantization, graph optimization, kernel tuning, memory optimization, and heterogeneous compute utilization.
• Conduct competitive benchmarking across AMD and competing CPU, GPU, APU, and AI accelerator platforms.
• Automate benchmark execution, data collection, regression analysis, and results visualization.
• Convert benchmarking results into actionable recommendations for software, hardware, product, and business teams.
• Collaborate with architects, framework, runtime, driver, firmware, and system software teams to resolve performance issues.

Required Skills & Experience

• 5 to 10 years of relevant experience in AI performance engineering, system performance analysis, workload optimization, or benchmarking.
• Hands-on experience benchmarking AI inference workloads on CPU, GPU, APU, or NPU platforms.
• Strong experience with PyTorch, ONNX Runtime, vLLM, llama.cpp, TensorFlow, or similar frameworks and runtimes.
• Strong Linux expertise with experience in performance profiling, workload tracing, automation, and system-level debugging.
• Experience with profiling tools such as Linux perf, AMD uProf, ROCm Profiler, Nsight Systems, VTune, Perfetto, or equivalent tools.
• Good understanding of CPU/GPU architecture, memory hierarchy, power and thermal behavior, and performance trade-offs.
• Proficiency in Python and Bash for automation, data analysis, and reporting.
• Ability to communicate complex performance data through clear technical reports, dashboards, and recommendations.

Preferred Qualifications

• Experience with ROCm, Ryzen AI Software, Vitis AI, MIGraphX, or related AI technologies.
• Knowledge of model quantization, mixed-precision inference, graph optimization, and LLM-serving techniques.
• Experience with MLPerf Inference, competitive benchmarking, Docker, virtualization, or post-silicon performance validation.

Education

• Bachelor’s or master’s degree in Computer Engineering, Electrical Engineering, Computer Science, Artificial Intelligence, Machine Learning, or a related field.

Benefits offered are described: AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process. AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here. This posting is for an existing vacancy.