AI Inference Backend Engineer - Cross-Framework Integration

Semiengineering

Burlingame (CA)

On-site

USD 130,000 - 170,000

Full time

9 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Quadric’s GPNPU runs both neural networks and C++ code on a single programmable architecture. As a member of our AI Application team, you will make the GPNPU a first-class backend in the frameworks developers already use, such as llama.cpp, PyTorch, and vLLM.

That way, customers can move their applications from GPUs to Quadric with minimal changes. You’ll own backend integration from memory and dispatch through serving features, working closely with our kernel, runtime and compiler teams.

Job description

Quadric’s GPNPU runs both neural networks and C++ code on a single programmable architecture. As a member of our AI Application team, you will make the GPNPU a first-class backend in the frameworks developers already use, such as llama.cpp, PyTorch, and vLLM.

That way, customers can move their applications from GPUs to Quadric with minimal changes. You’ll own backend integration from memory and dispatch through serving features, working closely with our kernel, runtime and compiler teams.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Inference Framework Engineer Quadric
AI Inference Framework Engineer Quadric

Semiengineering • Burlingame (CA)

On-site
USD 130,000 - 170,000
Edge AI Inference Framework Engineer (GPNPU)
Edge AI Inference Framework Engineer (GPNPU)

QUADRIC PTY LTD • Burlingame (CA)

On-site
USD 160,000 - 195,000
Medical, dental, and vision insurance
401(k) with matching
Equity in the company
+5
GPNPU AI Backend Engineer for Edge Inference
GPNPU AI Backend Engineer for Edge Inference

quadric • Burlingame (CA)

On-site
USD 160,000 - 195,000
Medical, dental, and vision insurance
Company-paid life Insurance
401(k) Retirement Plan
+3
Edge AI Inference Performance Engineer
Edge AI Inference Performance Engineer

quadric • Burlingame (CA)

On-site
USD 160,000 - 195,000
Medical, dental, vision insurance
Equity
401(k)
+6
AI Inference Framework Engineer
AI Inference Framework Engineer

quadric • Burlingame (CA)

On-site
USD 160,000 - 195,000
Medical, dental, and vision insurance
Company-paid life Insurance
401(k) Retirement Plan
+3
Edge AI Inference Optimization Engineer on GPNPU (Equity)
Edge AI Inference Optimization Engineer on GPNPU (Equity)

QUADRIC PTY LTD • Burlingame (CA)

On-site
USD 160,000 - 195,000
Medical, dental, and vision insurance
Equity in the company
401(k) Retirement Plan
+3
AI Inference Framework Engineer
AI Inference Framework Engineer

QUADRIC PTY LTD • Burlingame (CA)

On-site
USD 160,000 - 195,000
Medical, dental, and vision insurance
401(k) with matching
Equity in the company
+5
Staff Deep Learning Compiler Engineer Quadric
Staff Deep Learning Compiler Engineer Quadric

Semiengineering • United States

Remote
USD 140,000 - 230,000
Edge AI Kernel Intern: Optimize Inference on a GPNPU
Edge AI Kernel Intern: Optimize Inference on a GPNPU

quadric • Burlingame (CA)

On-site
USD 69,000 - 79,000
Catered lunch
Downtown Burlingame office
Work culture focused on innovation
+1
Edge AI Deep Learning Compiler Engineer
Edge AI Deep Learning Compiler Engineer

Semiengineering • United States

Remote
USD 140,000 - 230,000