Edge AI Inference Framework Engineer (GPNPU)

QUADRIC PTY LTD

Burlingame (CA)

On-site

USD 160,000 - 195,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Medical, dental, and vision insurance
401(k) with matching
Equity in the company
Flexible PTO
Paid Parental Leave
Caltrain commuter reimbursement
Office in Burlingame
Catered lunch daily

Job summary

Quadric is redefining edge AI with a programmable architecture. As a member of the AI Application team in Burlingame, you will integrate the GPNPU backend into existing AI compute frameworks such as llama.cpp, PyTorch, and vLLM.

You will own memory management, dispatch, and operators while collaborating with kernel, runtime, and compiler teams to bring new capabilities to production. You will optimize performance, validate accuracy, and deliver features like KV-cache and multi-modal decoding.

Qualifications

  • 3+ years building or extending ML frameworks or inference runtimes.
  • BS/MS in CS/CE or related fields.
  • Strong C/C++ and Python.
  • Solid understanding of framework internals: tensor memory management, graph scheduling, operator dispatch.
  • Solid understanding of AI compute performance analysis and optimization.
  • Preferred: experience writing an accelerator backend (CUDA/Metal/Vulkan/Hexagon) for an open-source framework.
  • Contributions to open-source frameworks (PyTorch, llama.cpp, vLLM).
  • Understanding of CPU/NPU, DMA and graph compilers.

Responsibilities

  • Integrate GPNPU backend into AI compute frameworks (llama.cpp, PyTorch, vLLM, Optimum)
  • Implement framework backend interface, memory allocation, compute dispatch, registration and operators/kernels
  • Implement model compute pipelines including prefill, decode, batching, multi-sequence and multi-modal
  • Support important serving features including KV-cache management, paged attention, continuous batching, speculative decoding

Skills

C/C++
Python
ML frameworks
Performance optimization
AI backend development
Open-source contributions
Understanding of AI compute pipelines

Education

BS/MS in CS/CE or related field

Tools

PyTorch
llama.cpp
vLLM

Job description

Quadric is redefining edge AI with a programmable architecture. As a member of the AI Application team in Burlingame, you will integrate the GPNPU backend into existing AI compute frameworks such as llama.cpp, PyTorch, and vLLM.

You will own memory management, dispatch, and operators while collaborating with kernel, runtime, and compiler teams to bring new capabilities to production. You will optimize performance, validate accuracy, and deliver features like KV-cache and multi-modal decoding.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GPNPU AI Backend Engineer for Edge Inference
GPNPU AI Backend Engineer for Edge Inference

quadric • Burlingame (CA)

On-site
USD 160,000 - 195,000
Medical, dental, and vision insurance
Company-paid life Insurance
401(k) Retirement Plan
+3
Edge AI Inference Performance Engineer
Edge AI Inference Performance Engineer

quadric • Burlingame (CA)

On-site
USD 160,000 - 195,000
Medical, dental, vision insurance
Equity
401(k)
+6
AI Inference Backend Engineer - Cross-Framework Integration
AI Inference Backend Engineer - Cross-Framework Integration

Semiengineering • Burlingame (CA)

On-site
USD 130,000 - 170,000
AI Inference Framework Engineer Quadric
AI Inference Framework Engineer Quadric

Semiengineering • Burlingame (CA)

On-site
USD 130,000 - 170,000
Edge AI Inference Optimization Engineer on GPNPU (Equity)
Edge AI Inference Optimization Engineer on GPNPU (Equity)

QUADRIC PTY LTD • Burlingame (CA)

On-site
USD 160,000 - 195,000
Medical, dental, and vision insurance
Equity in the company
401(k) Retirement Plan
+3
Edge AI Kernel Intern: Optimize Inference on a GPNPU
Edge AI Kernel Intern: Optimize Inference on a GPNPU

quadric • Burlingame (CA)

On-site
USD 69,000 - 79,000
Catered lunch
Downtown Burlingame office
Work culture focused on innovation
+1
Edge AI Deep Learning Compiler Engineer
Edge AI Deep Learning Compiler Engineer

Semiengineering • United States

Remote
USD 140,000 - 230,000
Edge AI Systems Software Engineer - Toolchains & Debugger
Edge AI Systems Software Engineer - Toolchains & Debugger

QUADRIC PTY LTD • Burlingame (CA)

On-site
USD 150,000 - 220,000
Medical, dental, and vision insurance
Equity
401(k) Retirement Plan
+2
Staff Deep Learning Compiler Engineer Quadric
Staff Deep Learning Compiler Engineer Quadric

Semiengineering • United States

Remote
USD 140,000 - 230,000
Edge AI Systems Engineer — Toolchain & Debugger
Edge AI Systems Engineer — Toolchain & Debugger

quadric • Burlingame (CA)

On-site
USD 150,000 - 220,000
Medical, dental, and vision insurance
401(k) Retirement Plan
Flexible PTO