ML Systems Engineer — Production-Scale LLM Inference

ChipAgents; San Jose (CA); On-site; USD 150,000 - 350,000; Full time

Benefits offered by this job

Unlimited PTO

Full benefits (medical, vision, dental, 401k)

Free parking and private gym

Job summary

ChipAgents is looking for a skilled ML Systems Engineer in San Jose, California. In this technical role, you will optimize large language model inference for our agentic AI platform, impacting chip design efficiency.

Your responsibilities include implementing performance optimizations, designing multi-node clusters, and collaborating with top semiconductor firms. With a competitive salary range of $150K–$350K, we also offer substantial benefits and equity options.

Qualifications

• B.S., M.S., or PhD in Computer Science, Electrical Engineering, or related field.
• Experience with large‑scale ML systems, GPU computing, or high‑performance inference optimization.
• Strong proficiency in Python and C++/CUDA.

Responsibilities

• Design, deploy, and optimize LLM inference systems across multi‑node clusters.
• Implement and benchmark inference optimizations.
• Profile and analyze inference bottlenecks at systems level.

Skills

Large-scale ML systems

GPU computing

High-performance inference optimization

Python

C++/CUDA

SGLang

vLLM

PyTorch

Debugging and profiling

Education

B.S., M.S., or PhD in Computer Science, Electrical Engineering, or related field

Tools

Distributed computing frameworks (Ray)

Job description

ChipAgents is looking for a skilled ML Systems Engineer in San Jose, California. In this technical role, you will optimize large language model inference for our agentic AI platform, impacting chip design efficiency.

Your responsibilities include implementing performance optimizations, designing multi-node clusters, and collaborating with top semiconductor firms. With a competitive salary range of $150K–$350K, we also offer substantial benefits and equity options.