Senior ML Inference Platform Engineer — Remote

Bright Vision Technologies; Beaverton (OR); Remote; USD 105,000 - 143,000; Full time

Job summary

Bright Vision Technologies is seeking a Machine Learning Infrastructure Engineer to design, build, and operate high-performance inference platforms for serving large ML models in production. The role emphasizes systems engineering for AI deployment, covering request routing, batching, caching, autoscaling, GPU utilization, and end-to-end observability across diverse model workloads.

The ideal candidate has strong distributed systems experience and hands-on experience with LLM inference

Qualifications

• Bachelor's or Master's degree in Computer Science or a related field.
• Six+ years of experience in distributed systems, infrastructure, or ML platform engineering.
• Proficiency in Python and a systems language (Go/Rust/C++).
• Experience operating high-throughput, low-latency services in production.
• Hands-on experience with LLM inference frameworks (vLLM, TensorRT-LLM).
• Strong knowledge of GPU architecture and accelerator utilization.
• Familiarity with Kubernetes, autoscaling, and cloud platforms.
• Experience with observability stacks (metrics, tracing, logging).
• Strong performance engineering and capacity planning skills.
• Good communication and incident response abilities.

Responsibilities

• Design, build, and operate high-performance ML inference platforms for production.
• Focus on systems engineering for AI deployment across diverse model workloads.
• Manage request routing, batching, caching, autoscaling, and GPU utilization.
• Ensure end-to-end observability and reliable operation of serving stacks.

Skills

Distributed systems

Python

Go/Rust/C++

Production services

LLM inference frameworks

GPU utilization

Kubernetes

Observability

Performance engineering

Incident response

Communication

Education

Bachelor's or Master's in Computer Science or related field

Tools

vLLM

TensorRT-LLM

Kubernetes

Cloud platforms (AWS/GCP/Azure)

Job description

Bright Vision Technologies is seeking a Machine Learning Infrastructure Engineer to design, build, and operate high-performance inference platforms for serving large ML models in production. The role emphasizes systems engineering for AI deployment, covering request routing, batching, caching, autoscaling, GPU utilization, and end-to-end observability across diverse model workloads.

The ideal candidate has strong distributed systems experience and hands-on experience with LLM inference