LLM Inference Systems Lead

WekaIO

United States

Remote

USD 220,000 - 320,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

WEKAIO seeks a Tech Lead to guide our AI Inference team, bridging research and production-grade engineering while growing a high-performing squad of three developers. You will balance hands-on work with people leadership to drive execution on high-performance LLM serving systems.

You will own end-to-end inference technology from core data paths to vLLM/LMCache serving stacks, set architecture standards, and mentor engineers to foster ownership, collaboration, and technical excellence within the

Qualifications

  • 8+ years of professional software engineering with leadership experience.
  • Hands-on background in AI inference or HPC infrastructure.
  • Proven ability to own production-grade systems end-to-end.

Responsibilities

  • Lead design, implementation, and delivery of high-throughput, low-latency LLM inference systems.
  • Mentor and coach engineers through regular 1:1s and sprint reviews.
  • Set architecture standards and guide tool and platform decisions.

Skills

Python
C++
CUDA
vLLM
Kubernetes
RDMA
HBM/NVMe
Rust

Tools

GDS
NIXL/Dynamo
NVMe data paths
RDMA networking

Job description

WEKAIO seeks a Tech Lead to guide our AI Inference team, bridging research and production-grade engineering while growing a high-performing squad of three developers. You will balance hands-on work with people leadership to drive execution on high-performance LLM serving systems.

You will own end-to-end inference technology from core data paths to vLLM/LMCache serving stacks, set architecture standards, and mentor engineers to foster ownership, collaboration, and technical excellence within the

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

LLM Inference Platform Lead & Product Strategy
LLM Inference Platform Lead & Product Strategy

FDE Times • San Francisco (CA)

On-site
USD 240,000 - 360,000
Senior LLM Inference Systems Engineer
Senior LLM Inference Systems Engineer

Snowflake • Menlo Park (CA)

On-site
USD 236,000 - 310,000
Bonus and equity plan
Medical, dental, vision insurance
401(k) retirement plan
+1
Tech Lead: LLM Inference & High-Performance Systems
Tech Lead: LLM Inference & High-Performance Systems

wekatest • United States

Remote
USD 180,000 - 240,000
Medical insurance
Dental insurance
Vision insurance
+5
AI Systems Architect & LLM Engineer
AI Systems Architect & LLM Engineer

Sphere Software • United States

Remote
USD 120,000 - 170,000
LLM Inference Systems Engineer
LLM Inference Systems Engineer

Netpreme • Santa Clara (CA), Boston (MA)

On-site
USD 170,000 - 210,000
Competitive salary with bonus
Health, Dental, and Vision for you and
401(k) match with immediate vesting
+7
LLM Inference Engineer: Peak-Performance AI Serving
LLM Inference Engineer: Peak-Performance AI Serving

Majestic Labs ai • Los Altos (CA)

On-site
USD 210,000 - 350,000
Senior LLM Inference Systems Engineer
Senior LLM Inference Systems Engineer

Snowflake • Menlo Park (CA)

On-site
USD 236,000 - 310,000
Medical insurance
Bonus & equity plan
401(k) retirement plan
+1
Head of LLM Inference Platform & Architecture
Head of LLM Inference Platform & Architecture

Modal • San Francisco (CA)

On-site
USD 240,000 - 360,000
AI Engineer / LLM Systems Engineer
AI Engineer / LLM Systems Engineer

Sphere Software • United States

On-site
USD 120,000 - 170,000
Senior AI Systems Research Engineer - LLM Inference
Senior AI Systems Research Engineer - LLM Inference

Snowflake • Bellevue (WA)

On-site
USD 236,000 - 310,000
Bonus and equity plan