Senior Edge AI Inference Engineer

Intel; Hillsboro (OR); Hybrid; USD 195,200 - 361,200; Full time

Benefits offered by this job

Hybrid work model

Competitive compensation

Job summary

Intel is hiring for an AI inference engineer focusing on optimizing local inference engines (llama.cpp, vLLM) for edge devices and hybrid environments. You will work on KV cache, batching, quantization, and CPU overhead reduction to enable fast, trustworthy local AI solutions.

The role demands deep C++/Python skills, Linux expertise, and experience with LLM inference at scale. This is a hybrid position with multiple US locations including Oregon, Hillsboro, and surrounding areas.

Qualifications

• BS/MS in CS, EE, Math or related STEM field
• 8+ years software development background
• Strong in C++ and/or Python; comfortable reading systems-level code
• Experience with LLM inference and attention, KV cache, decoding
• Experience profiling and optimizing real performance problems (CPU or GPU)
• Linux, build systems, and low-level debugging expertise

Responsibilities

• Profile and optimize local inference for latency, throughput, and memory on edge hardware
• Tune KV cache, batching, and scheduling for interactive workloads
• Drive quantization strategy and validate quality impact with the Post-Training team
• Cut CPU overhead and improve engine startup, model load, and lifecycle
• Benchmark across hardware tiers and publish performance comparisons
• Upstream fixes and patches to open-source engines where it helps us

Skills

C++

Python

LLM inference

Linux

Performance optimization

Profiling

Education

BS/MS in CS, EE, Math or related STEM field

Tools

llama.cpp

vLLM

ggml

CUDA

Vulkan

Job description

Intel is hiring for an AI inference engineer focusing on optimizing local inference engines (llama.cpp, vLLM) for edge devices and hybrid environments. You will work on KV cache, batching, quantization, and CPU overhead reduction to enable fast, trustworthy local AI solutions.

The role demands deep C++/Python skills, Linux expertise, and experience with LLM inference at scale. This is a hybrid position with multiple US locations including Oregon, Hillsboro, and surrounding areas.