Senior AI Inference Engineer — Edge ML, Porting Models

quadric.io, Inc; Burlingame (CA); On-site; USD 120,000 - 150,000; Full time

Benefits offered by this job

Health Care Plan (Medical, Dental & Vision)

Retirement Plan (401k, IRA)

Life Insurance (Basic, Voluntary & AD&D)

Paid Time Off (Vacation, Sick & Public Holidays)

Family Leave (Maternity, Paternity)

Short Term & Long Term Disability

Training & Development

Work From Home

Free Food & Snacks

Stock Option Plan

Job summary

A pioneering tech company is looking for an experienced AI Inference Engineer to bridge AI models and advanced processing platforms. This role requires expertise in AI model algorithms, strong C/C++ and Python skills, and experience with deployment frameworks. You will optimize and benchmark AI models, ensuring efficient deployment in edge devices. The position comes with comprehensive health benefits and flexible work options.

Qualifications

• 5+ years of experience in AI/LLM model inference and deployment frameworks/tools.
• Experience with model accuracy measures and performance profiling.
• Comfortable working with diverse AI tools and frameworks.

Responsibilities

• Quantize, prune, and convert models for deployment.
• Port models to Quadric platform using their toolchain.
• Benchmark and profile model performance and accuracy.

Skills

Model quantization (PTQ, QAT)

Proficiency in C/C++

Proficiency in Python

Problem solving and debugging

Education

Bachelor’s or Master’s in Computer Science or Electric Engineering

Tools

onnxruntime

Pytorch

huggingface-transformer

Job description

A pioneering tech company is looking for an experienced AI Inference Engineer to bridge AI models and advanced processing platforms. This role requires expertise in AI model algorithms, strong C/C++ and Python skills, and experience with deployment frameworks. You will optimize and benchmark AI models, ensuring efficient deployment in edge devices. The position comes with comprehensive health benefits and flexible work options.