AI Inference Platform Engineer (Hybrid, Equity)

ElastixAI INC.; Seattle (WA); Hybrid; USD 150,000 - 210,000; Full time

Benefits offered by this job

Comprehensive medical, dental, and vision coverage

Life insurance

Flexible Time Off (FTO)

Paid parental leave

Weekly catered lunches

Gym or fitness benefit

Job summary

A cutting-edge AI technology startup in Seattle is seeking a Systems-minded AI Software Engineer to join their core inference platform team. This role involves optimizing the AI serving platform, customizing open-source frameworks, and collaborating with engineers. Ideal candidates will have a background in systems programming, strong C++ and Python skills, and experience with LLM frameworks. The position offers competitive compensation, comprehensive healthcare coverage, and a flexible work environment.

Qualifications

• 3+ years of experience in systems programming, ML infrastructure, or distributed inference.
• Proficient in C++ and Python.
• Deep familiarity with LLM serving frameworks like vLLM or TensorRT-LLM.

Responsibilities

• Architect and extend core components of the AI serving platform.
• Customize open-source serving frameworks for model ingestion.
• Develop strategies for multi-device inference.

Skills

C++

Python

ML infrastructure

Distributed inference

Debugging

Performance analysis

Collaboration

Communication

Education

BS/MS/PhD in Computer Science, Electrical/Computer Engineering or related field

Tools

CUDA

PCIe

Docker

Kubernetes

Job description

A cutting-edge AI technology startup in Seattle is seeking a Systems-minded AI Software Engineer to join their core inference platform team. This role involves optimizing the AI serving platform, customizing open-source frameworks, and collaborating with engineers. Ideal candidates will have a background in systems programming, strong C++ and Python skills, and experience with LLM frameworks. The position offers competitive compensation, comprehensive healthcare coverage, and a flexible work environment.