Senior AI Performance Engineer - Edge Inference

Arm Limited; San Jose (CA); On-site; USD 263,000 - 355,000; Full time

Job summary

Arm Limited in San Jose seeks an engineer to optimize AI workloads on Arm technology, delivering best-in-class inference performance for production AI models. You will work closely with customers across the Bay Area, translating complex challenges into actionable insights and driving kernel-level improvements.

You will develop optimized kernel implementations, collaborate with multiple engineering teams, and help shape Arm's tooling roadmap with real-world use cases.

Qualifications

• Experience optimizing DNNs in kernel-level environments.
• Strong programming skills in Python and C++.
• Experience with modern AI frameworks and execution models.

Responsibilities

• Develop highly optimized solutions for AI workloads from kernel to system level.
• Create production-quality reference implementations, documentation, and performance-focused content.
• Act as a technical bridge between customers and internal teams to resolve performance issues.
• Influence Arm's IP and software roadmap from real-world customer insights.

Skills

Kernel-level programming

Python

C++

DNN optimization

Profiling tools

Communication

Tools

Triton

CUDA

Job description

Arm Limited in San Jose seeks an engineer to optimize AI workloads on Arm technology, delivering best-in-class inference performance for production AI models. You will work closely with customers across the Bay Area, translating complex challenges into actionable insights and driving kernel-level improvements.

You will develop optimized kernel implementations, collaborate with multiple engineering teams, and help shape Arm's tooling roadmap with real-world use cases.