AI Accelerator Software Principal Engineer- Framework Integration

Ampere; Warszawa; On-site; PLN 302,000 - 453,000; Full time

Benefits offered by this job

Premium medical health care

Generous paid time off

Office amenities and snacks

Remote work policy with reimbursement

Job summary

Ampere is a semiconductor design company forging a new era of high-performance, energy-efficient AI compute. As an AI Accelerator Software Principal Engineer – Framework Integration, you will own the strategy and delivery for DL inference across Ampere accelerators, enabling PyTorch/ONNX/llama.cpp integration that drives real-world performance from data centers to edge.

You will lead cross-team efforts, architect end-to-end acceleration across SW/HW, and mentor teams to raise the bar on quality

Qualifications

• Education & experience: BS CS/CE/EE or related field + 8y; or MS +6y; or PhD +3y.
• Deep framework expertise: PyTorch, ONNX, and llama.cpp integration with performance focus.
• Linux accelerator runtime/driver experience (preferred).
• Strong systems programming + performance tuning: Python and C/C++.

Responsibilities

• Framework integration leadership for PyTorch/ONNX/llama.cpp into Ampere backend.
• Drive end-to-end SW/HW acceleration across the stack including inference serving and runtime.
• Model enablement: optimize performance and accuracy for popular frameworks and stacks.
• HW/SW co-design to maximize efficiency and scalability across cores and memory.

Skills

Python

C/C++

PyTorch

ONNX

llama.cpp

Performance tuning

Framework integration

Education

BS in Computer Science/Engineering

MS in related field

PhD in related field

Tools

Linux

Linux drivers

Runtime libraries

Job description

Invent the future with us.

Ampere is a semiconductor design company for a new era, leading the future of computing with an innovative approach to CPU design focused on high-performance, energy efficient AI compute.

Description

Invent the future with us.

Ampere is a semiconductor design company for a new era, leading the future of computing with an innovative approach to CPU design focused on high-performance, energy efficient AI compute. As a pioneer in the new frontier of energy efficient high-performance computing, Ampere is part of the Softbank Group of companies driving sustainable computing for AI, Cloud, and edge applications. Join us at Ampere and work alongside a passionate and growing team.

About The Role

As an AI Accelerator Software Principal Engineer – Framework Integration, you will lead end-to-end technical strategy and delivery for high-performance deep learning inference across Ampere accelerator platforms. You will set direction for how major ML frameworks are enabled and optimized for our hardware, ensuring high throughput, low latency, and efficient compute/memory utilization for current and next-generation AI workloads spanning data centers to edge.

This role is distinguished by deep technical ownership, architecture leadership, and cross-team influence - driving outcomes from performance modeling and integration strategy through production-ready runtime and kernel behavior.

What You'll Achieve

• Framework integration leadership (PyTorch / ONNX / llama.cpp) Own and advance integration of major deep learning frameworks - PyTorch, ONNX, llama.cpp, and related tooling - into the Ampere deep learning accelerator backend, enabling robust execution of real-world model graphs and operators.


• Full-stack acceleration across the SW/HW execution path Drive acceleration across the end-to-end stack, including (as applicable):
  
  
  
  • inference serving and orchestration enablement
  
  
  • framework-to-runtime integration layers
  
  
  • compiler/graph lowering and optimization
  
  
  • runtime library and execution management
  
  
  • user-mode execution paths and performance-critical interfaces
  
  
  • compute kernel development and micro-optimizations
  
  
  • profiling, benchmarking, and continuous performance tuning
  
  
  
  


• Model enablement: performance + accuracy Lead efforts to improve performance and correctness for models using popular frameworks and serving stacks such as vLLM and SGLang, ensuring stable behavior under production inference patterns (prefill/decode, batching, KV cache behavior, scheduling, etc.).


• Hardware/software co-design and optimization Provide technical direction for HW/SW co-optimization of existing and evolving AI architectures to:
  
  
  
  • maximize computational efficiency
  
  
  • increase sustained throughput
  
  
  • reduce latency and variance
  
  
  • improve scalability across cores, memory hierarchies, and system configurations
  
  
  • raise the ceiling on what Ampere platforms can deliver
  
  
  
  


• Build and evolve state-of-the-art AI accelerator software Contribute to and shape the architecture of software/hardware AI co-processors and accelerators, defining reusable components, reference implementations, and performance guardrails.


• Cross-functional technical collaboration and influence Partner with compiler/runtime/kernel, platform, and systems teams to integrate and validate AI capabilities in Ampere's platforms and accelerators from cloud to edge.


• Mentorship and technical excellence Set engineering standards through code reviews, design reviews, benchmark methodologies, and mentorship - raising the overall bar for quality, maintainability, and performance.

About You

• Education & experience: BS Computer Science, Computer Engineering, Electrical Engineering, or Software Engineering or a related technical field & 8 years of related experience; or MS degree & 6 years; or PhD & 3 years


• Deep framework expertise: Proven experience with software development focused on PyTorch, ONNX, and llama.cpp, including integration, graph/operator enablement, and performance-focused engineering.


• Linux accelerator runtime / driver experience (preferred): Experience building or extending user-mode drivers and/or runtime libraries for GPUs or deep learning accelerators on Linux is a plus.


• Strong systems programming + performance tuning: Deep expertise in Python and C/C++, with a strong track record in performance engineering (profiling, optimization, throughput/latency analysis, memory behaviour).


• Solid ML/AI fundamentals: Strong understanding of AI/ML concepts (neural networks, data processing frameworks), and familiarity with modern model families including Transformers and Diffusion architectures.


• Fluent with modern AI development tools (preferred): Comfortable using modern AI programming tools and workflows such as Codex or Claude Code.

What We'll Offer

At Ampere we believe in taking care of our employees and providing a competitive total rewards package that includes base pay, cash long-term incentive, and comprehensive benefits. The full base pay range for this role is between 301,500 PLN and 452,500 PLN.

Benefit Highlights Include

• Premium medical health care, so that you and your family members can feel secure in your health.


• A generous paid time off policy so that you can embrace a healthy work-life balance.


• A wide variety of office amenities including nutritious snacks and refreshing drinks, free gym and sauna access to keep you fueled and healthy.


• Flexible working hours and a remote work policy that includes reimbursement of connectivity costs and equipment to work from home.


• Sports card fully financed by Ampere.

And there is much more than compensation and benefits. At Ampere, we foster an inclusive culture that empowers our employees to do more and grow more. We are excited to share more about our career opportunities with you through the interview process.

Ampere is an inclusive and equal opportunity employer and welcomes applicants from all backgrounds. All qualified applicants will receive consideration for employment without regard to race, color, national origin, citizenship, religion, age, veteran and/or military status, sex, sexual orientation, gender, gender identity, gender expression, physical or mental disability, or any other basis protected by federal, state or local law.