Senior Edge AI Inference Engineer

Quadric; Burlingame (CA); Hybrid; USD 110,000 - 270,000; Full time

Benefits offered by this job

Competitive salary and meaningful-equy

Medical dental vision plans from day 1

401(k) retirement plan

Flexible PTO (unlimited)

Caltrain passes

Downtown Burlingame office

Parking support

Collaborative work environment

Job summary

Quadric, based in Burlingame, California, seeks an AI Inference Engineer to bridge AI/LLM models with Quadric platforms. You will port models, optimize deployment for low latency, and profile performance, collaborating across the AI inference stack.

The role combines research with practical engineering in a hybrid Bay Area setting. Ideal candidates have 5+ years in AI model inference, strong C/C++ and Python skills, and experience with PTQ/QAT quantization and major frameworks.

Qualifications

• Bachelor's or Master's in Computer Science and/or Electrical Engineering.
• 5+ years of experience in AI/LLM model inference and deployment frameworks/tools.
• Experience with model quantization (PTQ, QAT) and tools.
• Experience with model accuracy measures.
• Experience with model inference performance profiling.
• Proficiency in C/C++ and Python.
• Demonstrate good capability in problem solving, debug and communication.

Responsibilities

• Quantize, prune and convert models for deployment.
• Port models to Quadric platform using Quadric toolchain.
• Optimize inference deployment for latency, speed.
• Benchmark and profile model performance and accuracy.
• Collaborate across related areas of the AI inference stack to support team and business priorities.
• Develop tools to scale and speed up the deployment.
• Make Improvement to SDK and runtime.
• Provide technical support and documents to customers and developer community.

Skills

AI model inference

Model deployment

C/C++

Python

Problem solving

Debugging

Communication

Quantization

Profiling

Education

Bachelor's or Master's in Computer Science or Electrical Engineering

Tools

onnxruntime

PyTorch

vLLM

huggingface-transformer

neural-compressor

llamacpp

Job description

Quadric, based in Burlingame, California, seeks an AI Inference Engineer to bridge AI/LLM models with Quadric platforms. You will port models, optimize deployment for low latency, and profile performance, collaborating across the AI inference stack.

The role combines research with practical engineering in a hybrid Bay Area setting. Ideal candidates have 5+ years in AI model inference, strong C/C++ and Python skills, and experience with PTQ/QAT quantization and major frameworks.