AI Inference Platform Engineer — Equity + On-Site Palo Alto

Premier Global Links; Palo Alto (CA); On-site; USD 230,000 - 350,000; Full time

Job summary

Premier Global Links LLC is seeking an experienced Member of Technical Staff, Inference Systems, to build and optimize a high-performance AI inference platform from the ground up. You will focus on LLM inference, model serving, distributed systems, and inference runtime performance.

The role requires hands-on experience with production inference systems and strong systems engineering skills, with Rust experience highly valued. On-site in Palo Alto, CA, five days a week.

Qualifications

• 2–10 years of backend, distributed systems, or systems engineering experience.
• Hands-on experience building, operating, or optimizing LLM inference or serving systems.
• Deep understanding of transformer inference internals: attention, KV cache, batching, scheduling.
• Experience with production inference engines such as vLLM, SGLang, or TensorRT‑LLM.
• Strong programming experience in Rust, C++, Go, or systems‑level Python/PyTorch.

Responsibilities

• Build and optimize production LLM inference and model-serving systems.
• Develop inference runtime components using Rust and other systems languages.
• Design and implement batching, scheduling, request routing, and serving infrastructure.
• Build and optimize KV cache and prefix caching systems.
• Scale inference workloads across multi-GPU and multi-node environments.
• Profile, benchmark, and optimize latency, throughput, reliability, and cost.
• Work with inference engines such as vLLM, SGLang, or TensorRT‑LLM.
• Investigate performance bottlenecks across the inference stack.
• Contribute to core architecture and technical decisions for the platform.
• Collaborate with a small, hands-on engineering team in a fast-paced environment.

Skills

LLM inference

Distributed systems

Rust programming

System-level Python/PyTorch

Latency optimization

KV cache

Transformer internals

Education

Bachelor's or Master's in CS/CE or related

Tools

vLLM

SGLang

TensorRT‑LLM

CUDA

Triton

NCCL

Job description

Premier Global Links LLC is seeking an experienced Member of Technical Staff, Inference Systems, to build and optimize a high-performance AI inference platform from the ground up. You will focus on LLM inference, model serving, distributed systems, and inference runtime performance.

The role requires hands-on experience with production inference systems and strong systems engineering skills, with Rust experience highly valued. On-site in Palo Alto, CA, five days a week.