Software Principal Engineer- AI Compiler

Ampere Computing LLC; Santa Clara (CA); Hybrid; USD 195,000 - 292,000; Full time

Benefits offered by this job

Health/dental/vision insurance

401K retirement plan

Unlimited flextime

Paid holidays

Job summary

Ampere Computing LLC is seeking a Software Principal Engineer- AI Compiler to optimize deep learning graphs on its accelerator. You will work across the stack—from inference serving to compute kernels—collaborating with hardware and software teams to push performance and efficiency.

Ideal candidates have strong CS fundamentals, experience with LLVM/MLIR, Python and C/C++, and a track record in compiler development or competitive programming. This role is Hybrid in the United States.

Qualifications

• Bachelor’s degree in Computer Science, Mathematics or related field; 8+ years experience or Master’s +6 years.
• Strong CS fundamentals: algorithms, data structures, systems.
• Experience with LLVM compiler framework and MLIR dialect.
• Solid graph algorithm knowledge and reasoning ability.
• Proficiency in Python and C/C++.
• Competitive programming achievements (IOI/ACM/Codeforces/USACO) a plus.
• Experience with PyTorch is a plus.
• CPU/GPU compiler development background preferred.

Responsibilities

• Optimize computational graphs to maximize performance on Ampere's accelerator.
• Bridge SW/HW stack from inference to compute kernels.
• Collaborate across teams for AI solution integration on hardware platforms.
• Support framework integration and compiler/runtime optimization.
• Contribute to HW/SW co-design for efficiency improvements.

Skills

Python

C/C++

Graph algorithms

Algorithms & data structures

Debugging & profiling

Education

Bachelor’s degree in CS/Math/related field

Master’s degree

Tools

LLVM compiler framework

MLIR dialect

PyTorch

Job description

Software Principal Engineer- AI Compiler

Ampere is a semiconductor design company for a new era, leading the future of computing by developing SoCs and platform solutions focused on high-performance, energy efficient AI compute. As a pioneer in the new frontier of energy efficient high-performance computing, Ampere is part of the Softbank Group of companies driving sustainable AI compute for cloud, edge, and physical applications.

AI is showing up in essentially every part of the technology landscape, and we’re focused on delivering the performance, efficiency, and reliability those workloads require. Ampere is building compute silicon and platforms for AI applications spanning a broad range of industries. We focus on solving exciting challenges in areas such as robotics and automotive, among others, but the core of our work is enabling efficient AI at scale and across multiple application domains.

About the Role:

In this role, you will optimize computational graphs to unlock the full potential of Ampere's deep learning accelerator. You'll work across the full SW/HW stack — from inference serving and framework integration down to compiler, runtime, and compute kernels.

What You’ll Achieve:

• Optimize deep learning computational graphs for performance, throughput, and latency on Ampere's accelerator hardware
• Enable popular models and frameworks (PyTorch, Llama.cpp) and serving platforms (vLLM, SGLang)
• Identify and implement graph-level optimizations: op fusion, pattern recognition, redundancy elimination
• Collaborate on HW/SW co-design to push computational efficiency
• Work with cross-functional teams to integrate AI solutions into Ampere's AI hardware platforms

About You:

• Bachelors degree in Computer Science, Mathematics or a related technical field & 8 years of related experience; or Master's degree & 6 years
• Strong CS fundamentals: algorithms, data structures, systems
• Experience with LLVM compiler framework as well as MLIR dialect
• Solid graph algorithm knowledge and reasoning ability
• Proficiency in Python and C/C++
• Demonstrated exceptional problem-solving ability — IOI medal, ACM ICPC medal, Codeforces Grandmaster, USACO Platinum, or equivalent competitive programming achievement is a big plus
• Preferred to have traditional CPU or GPU compiler development background
• Experience with PyTorch is a plus
• Fast learner who can pick up new domains quickly and maximize agent-assisted development
• Familiarity with deep learning concepts and neural network architectures is a plus

What We’ll Offer:

At Ampere we believe in taking care of our employees and providing a competitive total rewards package that includes base pay, cash long-term incentive, and comprehensive benefits. The full base pay range for this role is between $195,000 and $292,000. Our benefits include health, wellness, and financial programs that support employees through every stage of life.

Benefit highlights include:

• Premium medical insurance, dental insurance, vision insurance, as well as income protection and a 401K retirement plan, so that you can feel secure in your health and financial future.
• Unlimited Flextime and 10+ paid holidays so that you can embrace a healthy work-life balance.
• A variety of healthy snacks, energizing espresso, and refreshing drinks to keep you fueled and focused throughout the day.

And there is much more than compensation and benefits. At Ampere, we foster an inclusive culture that empowers our employees to do more and grow more. We are excited to share more about our career opportunities with you through the interview process. Our benefits include health, wellness, and financial programs that support employees through every stage of life.

#LI-Hybrid

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Ampere is an inclusive and equal opportunity employer and welcomes applicants from all backgrounds. All qualified applicants will receive consideration for employment without regard to race, color, national origin, citizenship, religion, age, veteran and/or military status, sex, sexual orientation, gender, gender identity, gender expression, physical or mental disability, or any other basis protected by federal, state or local law.