Senior ML Inference Platform Engineer — Remote

Stack AV; Pittsburgh (Allegheny County); Hybrid; USD 100,000 - 130,000; Full time

Job summary

Stack AV is seeking a Senior Software Engineer for their Machine Learning Inference Platform in Pittsburgh, PA or Remote. You will be responsible for the design and implementation of meaningful subsystems, focusing on model onboarding, performance optimization, and mentoring engineers.

We're looking for candidates with a Bachelor's or Master's degree in Computer Science or related field, and 4+ years of experience in backend distributed systems. Strong programming skills in C++, Go, or Python are essential. An equal opportunity workplace committed to diversity and inclusion, Stack AV is dedicated to building innovative autonomous solutions.

Qualifications

• 4+ years of experience building and operating backend distributed systems end to end.
• Strong foundation in data-intensive distributed systems, concurrency, networking, and performance profiling.
• Hands-on experience with large-scale inference services on GPUs.

Responsibilities

• Own technical design and delivery of subsystems in a multi-tenant inference platform.
• Develop robust API layers and SDKs for distributed inference orchestration.
• Partner with product and infrastructure teams for model onboarding.

Skills

C++

Go

Rust

Python

Deep Learning Frameworks (PyTorch, etc.)

CUDA

NCCL

NVLink

Networking Architectures

Education

Bachelor's or Master's degree in Computer Science, Engineering, or related field

Tools

TensorRT

Dynamo

Triton Framework

Job description

Stack AV is seeking a Senior Software Engineer for their Machine Learning Inference Platform in Pittsburgh, PA or Remote. You will be responsible for the design and implementation of meaningful subsystems, focusing on model onboarding, performance optimization, and mentoring engineers.

We're looking for candidates with a Bachelor's or Master's degree in Computer Science or related field, and 4+ years of experience in backend distributed systems. Strong programming skills in C++, Go, or Python are essential. An equal opportunity workplace committed to diversity and inclusion, Stack AV is dedicated to building innovative autonomous solutions.