Remote AI Inference Engineer — Edge Model Deployment & Optimization

Quadric Inc.; Burlingame (CA); On-site; Full time

Benefits offered by this job

Health Care Plan (Medical, Dental & Vision)

Retirement Plan (401k, IRA)

Life Insurance (Basic, Voluntary & AD&D)

Paid Time Off (Vacation, Sick & Public Holidays)

Family Leave (Maternity, Paternity)

Short Term & Long Term Disability

Training & Development

Work From Home

Free Food & Snacks

Stock Option Plan

Job summary

A leading technology company in California is seeking an AI Inference Engineer to bridge AI models with unique platforms. Key responsibilities include model optimization, deployment, and performance profiling. Candidates should have a Bachelor’s or Master’s degree, 5+ years' experience in AI frameworks, and proficiency in C/C++ and Python. Competitive benefits included, such as health care, retirement plans, and work from home options.

Qualifications

• 5+ years of experience in AI/LLM model inference and deployment frameworks/tools.
• Experience with model quantization (PTQ, QAT) and tools.
• Proficiency in C/C++ and Python.

Responsibilities

• Quantize, prune and convert models for deployment.
• Port models to Quadric platform using Quadric toolchain.
• Optimize inference deployment for latency, speed.
• Benchmark and profile model performance and accuracy.
• Develop tools to scale and speed up the deployment.
• Provide technical support and documents to customers and developers.

Skills

AI model algorithms

System architecture

AI toolchains/frameworks

Problem solving

Debugging

Communication

Education

Bachelor’s or Master’s in Computer Science or Electrical Engineering

Tools

onnxruntime

Pytorch

vLLM

huggingface-transformer

neural-compressor

llamacpp

Job description

A leading technology company in California is seeking an AI Inference Engineer to bridge AI models with unique platforms. Key responsibilities include model optimization, deployment, and performance profiling. Candidates should have a Bachelor’s or Master’s degree, 5+ years' experience in AI frameworks, and proficiency in C/C++ and Python. Competitive benefits included, such as health care, retirement plans, and work from home options.