Senior LLM Inference Engineer — End-to-End Optimizer

Entrada Ventures; Santa Clara (CA); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Competitive compensation

Equity

Benefits

Job summary

Entrada Ventures in Santa Clara is seeking end-to-end inference engineers to work on innovative AI architecture. Candidates will enjoy ownership from research to deployment, tackling optimization challenges unique to D-Matrix's groundbreaking hardware.

Excellent communication, experience with AI frameworks, and strong proficiency in Python and C/C++ are essential. Other benefits include competitive compensation and opportunity for influence within a senior team.

Qualifications

• Bachelor's degree in a related field with 10+ years of engineering experience.
• Master's or PhD preferred with 6+ years relevant industry experience.
• Strong proficiency in Python and C/C++.

Responsibilities

• Identify and prototype emerging LLM inference use cases for heterogeneous hardware.
• Build proof-of-concept systems demonstrating D-Matrix capabilities.
• Contribute to distributed inference systems and partner with product development.

Skills

Python

C/C++

LLM inference optimization

CUDA

Performance profiling tools

Education

Bachelor's in Computer Science or Electrical Engineering

Master's or PhD in related field

Tools

vLLM

SGLang

TensorRT-LLM

ONNX Runtime

Job description

Entrada Ventures in Santa Clara is seeking end-to-end inference engineers to work on innovative AI architecture. Candidates will enjoy ownership from research to deployment, tackling optimization challenges unique to D-Matrix's groundbreaking hardware.

Excellent communication, experience with AI frameworks, and strong proficiency in Python and C/C++ are essential. Other benefits include competitive compensation and opportunity for influence within a senior team.