AI Accelerator Software Principal Engineer – Runtime Library

Ampere Computing LLC; Warszawa; Hybrid; PLN 302,000 - 453,000; Full time

Benefits offered by this job

Premium medical care

Paid time off

Remote work stipend

Gym and sauna access

Sports card

Job summary

Ampere Computing LLC is hiring an AI Accelerator Principal Software Engineer – Runtime Library to lead design, development, and optimization of AI runtime software on Ampere accelerators. You will improve throughput, latency, memory efficiency, and cross-framework support, collaborating with hardware and platform teams.

The role requires strong C/C++, systems programming, and hands-on AI framework experience (PyTorch/llama.cpp/ONNX) in Linux/RTOS environments, with a focus on scalable,

Qualifications

• BS Computer Science, Computer Engineering, Electrical Engineering, or Software Engineering or related technical field with 8+ years experience; or MS with 6+ years; or PhD with 3+ years.
• Experience developing user-mode drivers and/or runtime libraries for GPUs or DL accelerators in Linux or RTOS.
• Strong C/C++ and systems-level programming skills.
• Hands-on AI framework enablement: PyTorch, llama.cpp, ONNX.
• Strong performance engineering: profiling, diagnostics, optimization of pipelines.

Responsibilities

• Build and evolve an AI Runtime Library for Ampere accelerators for multiple model types and frameworks.
• Own end-to-end acceleration paths across SW/HW stack including inference serving and runtime interfaces.
• Drive HW/SW co-design and optimization for throughput, latency, and memory efficiency.
• Collaborate to integrate runtime components into Ampere platform stacks and production workloads.

Skills

C/C++

Systems-level programming

Performance profiling

AI framework enablement

PyTorch

llama.cpp

ONNX

Linux/RTOS

Education

Bachelor's degree in CS/CE/EE

Tools

PyTorch

llama.cpp

ONNX

Job description

AI Accelerator Software Principal Engineer – Runtime Library

Ampere is a semiconductor design company for a new era, leading the future of computing with an innovative approach to CPU design focused on high-performance, energy efficient AI compute.

As a pioneer in the new frontier of energy efficient high-performance computing, Ampere is part of the Softbank Group of companies driving sustainable computing for AI, Cloud, and edge applications.

Join us at Ampere and work alongside a passionate and growing team-we’dlove to have you apply!

About the Role:

As an AI Accelerator Principal Software Engineer – Runtime Library, you will lead the design, development, and optimization of AI runtime software that enables multiple state-of-the-art deep learning models to run efficiently on Ampere’s deep learning accelerators. You will work at the intersection of systems software, performance engineering, and AI enablement, helping deliver high-throughput, low-latency inference and a strong foundation for future model and framework support.

What You’ll Achieve:

• Build and evolve an AI Runtime Libraryfor Ampere accelerators that supports execution, scheduling, and lifecycle management of deep learning workloads across multiple model types and popular frameworks.
• Own end-to-end acceleration paths, going deep into the full SW/HW stack—including:
• Inference serving and integration layers
• Compiler/runtime interfaces and graph/IR execution flows
• Runtime library architecture (APIs, memory management, operators, execution engines)
• Communication mechanisms and device/host orchestration
• Drive HW/SW co-design and optimizationto improve:
• Throughput (tokens/requests per second)
• Latency (kernel execution and scheduling efficiency)
• Memory efficiency (buffering, paging, reuse, caching)
• Overall compute utilization and scaling behavior
• Contribute to AI co-processor/accelerator software enablement, partnering closely with hardware and systems teams to ensure runtime and kernel strategies match accelerator capabilities and constraints.
• Collaborate cross-functionallyto integrate runtime components into Ampere platform stacks, ensuring robust deployment on target environments and consistent performance in production-like workloads.

About You:

• BS Computer Science, Computer Engineering, Electrical Engineering, or Software Engineering or related technical field & 8 years of related experience; or MS degree & 6 years; or PhD & 3 years
• Proven experience developing user-mode drivers and/or runtime libraries for GPUs or deep learning accelerators in Linux or RTOS environments.
• Strong expertise in C/C++ and systems-level programming (memory, threading, synchronization, performance profiling).
• Demonstrated background in AI framework enablement, with hands-on experience in one or more of:
• PyTorch (operator/runtime integration, graph execution, correctness/performance work)
• llama.cpp (inference/runtime execution patterns)
• ONNX (graph handling, interoperability, execution engines)
• Strong performance engineering skills, including profiling/diagnostics and optimization of execution pipelines, data movement, and compute kernels.
• Ability to operate effectively in a collaborative environment—owning complex components while partnering with compilers, hardware, and platform teams.

Whatwe’lloffer:

At Ampere we believe in taking care of our employees and providing a competitive total rewards package that includes base pay, cash long-term incentive, and comprehensive benefits. The full base pay range for this role is between 301,500 PLN and 452,500 PLN.

Benefit highlights include:

• Premium medical health care, so that you and your family members can feel secure in your health.
• A generous paid time off policy so that you can embrace a healthy work-life balance.
• A wide variety of office amenities including nutritious snacks and refreshing drinks, free gym and sauna access to keep you fueled and healthy.
• Flexible working hours and a remote work policy that includes reimbursement of connectivity costs and equipment to work from home.
• Sports card fully financed by Ampere.

And there is much more than compensation and benefits. At Ampere, we foster an inclusive culture that empowers our employees to do more and grow more. We are excited to share more about our career opportunities with you through the interview process.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Ampere is an inclusive and equal opportunity employer and welcomes applicants from all backgrounds. All qualified applicants will receive consideration for employment without regard to race, color, national origin, citizenship, religion, age, veteran and/or military status, sex, sexual orientation, gender, gender identity, gender expression, physical or mental disability, or any other basis protected by federal, state or local law.