Principal AI Runtime Software Engineer — Accelerator

Ampere Computing LLC; Santa Clara (CA); On-site; USD 182,000 - 273,000; Full time

Benefits offered by this job

Premium medical insurance

401K retirement plan

Unlimited Flextime

10+ paid holidays

Snacks and beverages

Job summary

Ampere Computing LLC is seeking an AI Accelerator Principal Software Engineer - Runtime Library to lead design, development, and optimization of AI runtime software for Ampere accelerators, enabling efficient inference across models and frameworks.

You will own end-to-end acceleration paths across SW/HW stack, including inference serving, compiler/runtime interfaces, memory management, and host-device orchestration, collaborating with hardware and platform teams.

Qualifications

• BS/MS/PhD and 8+ years experience in software for GPUs or accelerators.
• Proven driver/runtime development in Linux/RTOS.
• Strong C/C++ and systems-level programming; performance-focused.

Responsibilities

• Design, implement, and optimize AI runtime libraries for Ampere accelerators.
• Own end-to-end acceleration paths across SW/HW stacks.
• Collaborate with hardware, compiler, and platform teams to deliver production-ready solutions.

Skills

C/C++ systems programming

Linux/RTOS driver/runtime development

AI framework enablement (PyTorch/ONNX/

Performance profiling & optimization

Education

BS in Computer Science/Engineering or related field

MS or PhD with relevant experience

Tools

PyTorch

llama.cpp

ONNX

Job description

Ampere Computing LLC is seeking an AI Accelerator Principal Software Engineer - Runtime Library to lead design, development, and optimization of AI runtime software for Ampere accelerators, enabling efficient inference across models and frameworks.

You will own end-to-end acceleration paths across SW/HW stack, including inference serving, compiler/runtime interfaces, memory management, and host-device orchestration, collaborating with hardware and platform teams.