AI Systems Engineer: ML Kernels & HPC Acceleration

Socket.dev; San Jose (CA); Hybrid; USD 150,000 - 190,000; Full time

Job summary

AMD seeks an AI Systems Engineer to advance ML workloads on AMD AI accelerators, bridging hardware and software from kernel design to production inference across NPU and GPU platforms.

You will collaborate with compiler, runtime, silicon, and architecture teams, delivering high-performance AI solutions and steering hardware-software co-design efforts in a hybrid San Jose, CA environment.

Qualifications

• Strong software development experience in C/C++ and Python.
• Experience with parallel programming and performance optimization.
• Knowledge of ML inference workloads and common operators.
• Familiarity with AI frameworks and runtimes such as PyTorch, ONNX Runtime, ROCm.

Responsibilities

• Develop and optimize ML operator kernels and dataflow libraries for AMD AI accelerators.
• Profile workloads, identify bottlenecks, and drive optimizations.
• Enable and validate ML models within production inference frameworks and runtimes.
• Collaborate with compiler, runtime, architecture, and silicon teams to deliver high-performance AI solutions.
• Debug and resolve issues spanning kernel implementation, runtime integration, model accuracy, and hardware bring-up.
• Contribute to hardware-software co-design by evaluating architectural tradeoffs.
• Drive innovation in performance methodologies, tooling, and AI system optimization.

Skills

C/C++

Python

Education

Master's or PhD in Computer Engineering, Electrical Engineering, Computer Science

Tools

MLIR

LLVM

Job description

AMD seeks an AI Systems Engineer to advance ML workloads on AMD AI accelerators, bridging hardware and software from kernel design to production inference across NPU and GPU platforms.

You will collaborate with compiler, runtime, silicon, and architecture teams, delivering high-performance AI solutions and steering hardware-software co-design efforts in a hybrid San Jose, CA environment.