Remote AI Accelerator Software Lead — Framework & Performance

Ampere; Warszawa; Hybrid; PLN 416,500 - 624,500; Full time

Benefits offered by this job

Premium medical health care

Generous paid time off

Office amenities

Flexible working hours & remote work

Sports card fully financed

Job summary

Ampere, a semiconductor design company, seeks an AI Accelerator Software Senior Principal Engineer – Framework Integration to lead end-to-end strategy for high‑performance DL inference and optimization across Ampere accelerator platforms.

You will drive integration of PyTorch, ONNX, llama.cpp, and related tooling into the backend, ensuring robust execution of real-world model graphs with low latency and high throughput across data centers to edge.

Qualifications

• BS/MS/PhD in a technical field with years of related experience.
• Proven experience with PyTorch, ONNX, and llama.cpp integration.
• Strong Linux accelerator runtime/driver experience is a plus.

Responsibilities

• Lead end-to-end technical strategy for high-performance DL inference.
• Drive framework-to-runtime integration and optimization across HW/SW.
• Guide model enablement for accuracy and performance in production.
• Shape HW/SW co-design and platform-level optimizations.
• Develop reusable software components and performance guardrails.
• Collaborate cross-functionally with compiler/runtime/kernel teams.

Skills

Python

C/C++

Performance tuning

Systems programming

Framework integration

ML concepts

Education

BS in CS/CE/EE

MS in CS/EE

PhD in related field

Tools

PyTorch

ONNX

llama.cpp

Job description

Ampere, a semiconductor design company, seeks an AI Accelerator Software Senior Principal Engineer – Framework Integration to lead end-to-end strategy for high‑performance DL inference and optimization across Ampere accelerator platforms.

You will drive integration of PyTorch, ONNX, llama.cpp, and related tooling into the backend, ensuring robust execution of real-world model graphs with low latency and high throughput across data centers to edge.