Senior AI Inference Systems Engineer - Hybrid, Santa Clara

Entrada Ventures; Santa Clara (CA); Hybrid; USD 180,000 - 260,000; Full time

Job summary

d-Matrix, headquartered in Santa Clara, CA, seeks a Principal System Software Engineer for AI Inference Execution. You will join the software team to productize the AI compute engine's SW stack, developing deployment software and collaborating with ML, compiler, and hardware experts.

Required: strong background in system software and architecture, proficiency in C/C++/Python on Linux, and experience with distributed, high-performance software.

Qualifications

• BS in Computer Science, Engineering, Math, Physics, or related degree.
• 12+ years of industry software development experience (MS preferred with 6+ years).
• Strong grasp of system software, computer architecture, and ML fundamentals.
• Proficient in C/C++/Python development in Linux and standard tools.
• Experience with distributed, high-performance software design and implementation.
• Self-motivated team player with ownership and leadership.

Responsibilities

• Productize the SW stack for the AI compute engine deployment.
• Develop, enhance, and maintain the next-generation deployment software.
• Collaborate with ML, compilers, and hardware teams across the full stack.

Skills

System software

Data structures

Computer architecture

Machine learning basics

C/C++/Python

Linux development

Distributed systems

Ownership and leadership

Education

Bachelor's degree in Computer Science, Engineering, Math, Physics, or related

MS in Computer Science, Engineering, Math, Physics, or related

Tools

Kubernetes

Ray

NCCL

OpenMPI

TensorRT

vLLM

PyTorch

TensorFlow

ONNX Runtime

Job description

d-Matrix, headquartered in Santa Clara, CA, seeks a Principal System Software Engineer for AI Inference Execution. You will join the software team to productize the AI compute engine's SW stack, developing deployment software and collaborating with ML, compiler, and hardware experts.

Required: strong background in system software and architecture, proficiency in C/C++/Python on Linux, and experience with distributed, high-performance software.