Principal AI Performance Engineer

Arm Limited; San Jose (CA); On-site; USD 263,000 - 355,000; Full time

Job summary

Arm Limited in San Jose seeks an engineer to optimize AI workloads on Arm technology, delivering best-in-class inference performance for production AI models. You will work closely with customers across the Bay Area, translating complex challenges into actionable insights and driving kernel-level improvements.

You will develop optimized kernel implementations, collaborate with multiple engineering teams, and help shape Arm's tooling roadmap with real-world use cases.

Qualifications

• Experience optimizing DNNs in kernel-level environments.
• Strong programming skills in Python and C++.
• Experience with modern AI frameworks and execution models.

Responsibilities

• Develop highly optimized solutions for AI workloads from kernel to system level.
• Create production-quality reference implementations, documentation, and performance-focused content.
• Act as a technical bridge between customers and internal teams to resolve performance issues.
• Influence Arm's IP and software roadmap from real-world customer insights.

Skills

Kernel-level programming

Python

C++

DNN optimization

Profiling tools

Communication

Tools

Triton

CUDA

Job description

Job Summary:

Are you passionate about optimizing AI workloads and delivering real-world performance improvements on edge devices?

We’re looking for an experienced engineer to help customers achieve best-in-class inference performance for production AI models running on Arm technology.

This role is based in San Jose, with significant time spent working directly with customers across the Bay Area.

Job Description:

In this role, you will work closely with customers to optimize AI workloads targeting Arm technology, focusing on achieving best-in-class performance and power efficiency.

Using your experience with Arm’s AI optimization tools and your understanding of hardware architectures, you will develop kernel level implementations across a range of DNN models, optimizing for power and performance.

In collaboration with multiple teams across Arm’s engineering organization, you will diagnose and resolve performance challenges, and use these insights to influence Arm's IP and tooling roadmaps.

This role requires strong coding and communication skills; you’ll translate complex technical challenges into clear insights, presenting progress and recommendations to audiences ranging from engineers to senior leadership.

Responsibilities:

• Develop highly optimized solutions for AI workloads, from kernel level to system level, to meet the needs of the customer application.
• Create production quality reference implementations, documentation, and performance focused technical content
• Act as a technical bridge between customers and internal teams, driving resolution of complex performance issues
• Influence Arm's IP and software roadmap through insights gained from real-world customer use cases

Required Skills and Experience :

• Experience optimizing DNNs in Triton, CUDA or other kernel level programming language
• Deep understanding of parallel computing, memory hierarchies and performance optimization techniques for DNNs
• Strong programming skills in Python and C++, a solid experience with modern AI frameworks and execution models, experience with profiling and analysis tools
• Strong communication and interpersonal skills

Nice To Have:

• Experience in a customer facing or field engineering environment
• Experience within the Arm ecosystem
• Background in AI performance optimization for edge devices

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

In Return:

Joining Arm means stepping into a career‑defining opportunity. You’ll occupy a central role in the company’s most critical initiatives. These initiatives build how Arm innovates, scales, and partners globally.

Additional Information

Please note this role does not meet the eligibility requirements for sponsorship, and therefore the successful candidate must have the right to work in the US without relying on sponsorship by Arm.

10x Mindset at Arm

At Arm, we believe progress happens when people are empowered to think bigger and push beyond what seems possible. Our 10x mindset is about curiosity, ambition and creating impact that will be used by millions. We learn fast, prioritise collaboration and turn bold ideas into real technology. We look for people who are inspired by this way of working and want to grow in an environment where bold ideas are welcomed. Read more about how we bring the 10x mindset to life on the Arm blog.

Accommodations at Arm

At Arm, we want to build extraordinary teams. If you need an adjustment or an accommodation during the recruitment process, please email [e-mail]. To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation or adjustment requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud, or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.

Equal Opportunities at Arm

Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don’t discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Hybrid Working at Arm

Arm’s hybrid approach to working is centred around flexibility, where we split our time between the office and other locations to get our work done. Within that framework, we empower groups and teams to determine their own particular hybrid working pattern, depending on the work and the team’s needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.

Salary Range:

$262,700-$355,400 per year

We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Accommodations at Arm

At Arm, we want to build extraordinary teams. If you need an adjustment or an accommodation during the recruitment process, please email [e-mail]. To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation or adjustment requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud, or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.

Hybrid Working at Arm

Arm’s approach to hybrid working is designed to create a working environment that supports both high performance and personal wellbeing. We believe in bringing people together face to face to enable us to work at pace, whilst recognizing the value of flexibility. Within that framework, we empower groups/teams to determine their own hybrid working patterns, depending on the work and the team’s needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.

Equal Opportunities at Arm

Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don’t discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.