Edge AI Performance Engineer (Kernel & Optimization)

Arm

San Jose (CA)

Hybrid

USD 263,000 - 355,000

Full time

37 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Arm in San Jose seeks an experienced engineer to optimize AI workloads and deliver best-in-class inference performance on Arm technology. You will collaborate across teams, translating complex challenges into clear insights for engineers and leadership.

The role focuses on kernel-level implementations, power/performance optimization, and close work with customers across the Bay Area. Strong coding and communication skills are essential.

Qualifications

  • Experience optimizing DNNs in Triton, CUDA or other kernel level programming language.
  • Deep understanding of parallel computing, memory hierarchies and performance optimization techniques for DNNs.
  • Strong programming skills in Python and C++, a solid experience with modern AI frameworks and execution models, profiling and analysis tools.
  • Strong communication and interpersonal skills.

Responsibilities

  • Develop highly optimized solutions for AI workloads from kernel to system level.
  • Create production quality reference implementations, documentation, and performance-focused content.
  • Act as a technical bridge between customers and internal teams to resolve performance issues.
  • Influence Arm’s IP and software roadmap based on real-world customer insights.

Skills

DNN optimization (Triton/CUDA)
Parallel computing
Python & C++
Communication skills

Job description

Arm in San Jose seeks an experienced engineer to optimize AI workloads and deliver best-in-class inference performance on Arm technology. You will collaborate across teams, translating complex challenges into clear insights for engineers and leadership.

The role focuses on kernel-level implementations, power/performance optimization, and close work with customers across the Bay Area. Strong coding and communication skills are essential.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Performance Engineer - Edge Inference
Senior AI Performance Engineer - Edge Inference

Arm Limited • San Jose (CA)

On-site
USD 263,000 - 355,000
Kernel Engineer for AI Inference Performance
Kernel Engineer for AI Inference Performance

Acceler8 Talent • San Francisco (CA)

Hybrid
USD 180,000 - 230,000
AI Performance Engineer – HPC, ARM & Distributed Inference
AI Performance Engineer – HPC, ARM & Distributed Inference

EngineersOfAI • Austin (TX)

On-site
USD 90,000 - 120,000
Kernel Performance Engineer - AI Tooling & Systems
Kernel Performance Engineer - AI Tooling & Systems

OpenAI • San Francisco (CA)

On-site
USD 120,000 - 160,000
AI Performance & Kernel Engineer for Frontier-Scale ML
AI Performance & Kernel Engineer for Frontier-Scale ML

Zyphra • San Francisco (CA)

On-site
USD 120,000 - 160,000
Comprehensive medical, dental, vision, and FSA plans
Competitive compensation and 401(k) plan
Relocation and immigration support
+3
AI Inference Engineer - Kernel & Edge Optimization
AI Inference Engineer - Kernel & Edge Optimization

Jobgether SRL • United States

Remote
USD 82,000 - 177,000
Remote-first team
Exposure to cutting-edge AI research
Collaborative engineering environment
Senior AI Inference Runtime Engineer - Distributed
Senior AI Inference Runtime Engineer - Distributed

Arm Limited • Seattle (WA)

Hybrid
USD 209,000 - 283,000
Edge AI DevRel Engineer: On-Device ML & Optimization
Edge AI DevRel Engineer: On-Device ML & Optimization

Arm Limited • United States

Hybrid
USD 120,000 - 180,000
Kernel Engineer — High-Performance AI Inference
Kernel Engineer — High-Performance AI Inference

Acceler8 Talent • Santa Clara (CA)

On-site
USD 170,000 - 350,000
Equity / stock options
Medical, dental, and vision coverage
Unlimited PTO
+1
Senior AI Kernel & Performance Engineer
Senior AI Kernel & Performance Engineer

Meta • Bellevue (WA)

Hybrid
USD 180,000 - 260,000