Senior ML Infrastructure Engineer — Remote

Bright Vision Technologies; Hillsboro (OR); Remote; USD 105,000 - 143,000; Full time

Job summary

Bright Vision Technologies is seeking a Machine Learning Infrastructure Engineer for a fully remote role. The candidate will design, build, and operate high-performance inference platforms for serving large ML models in production, focusing on latency, throughput, cost, and observability.

A strong background in distributed systems and Python plus Go/Rust/C++ is required. The role emphasizes scalable serving, GPU utilization, and end-to-end observability across diverse model workloads, with a

Qualifications

• Bachelor’s or Master’s degree in Computer Science or a related field.
• Six-plus years in distributed systems, infrastructure, or ML platform engineering.
• Proficiency in Python and a systems language (Go, Rust or C++).
• Experience with ML serving frameworks and GPU utilization.

Responsibilities

• Design, build and operate high-performance ML inference platforms.
• Optimize request routing, batching, caching, autoscaling and observability.
• Collaborate on cost-aware serving design and cross-team incident response.

Skills

Python

Go

Rust

C++

Distributed systems

Performance engineering

Observability

Incident response

Cloud platforms

Communication

Education

Bachelor’s or Master’s degree in Computer Science or a related field

Tools

Kubernetes

TensorRT-LLM

vLLM

GPU acceleration

Job description

Bright Vision Technologies is seeking a Machine Learning Infrastructure Engineer for a fully remote role. The candidate will design, build, and operate high-performance inference platforms for serving large ML models in production, focusing on latency, throughput, cost, and observability.

A strong background in distributed systems and Python plus Go/Rust/C++ is required. The role emphasizes scalable serving, GPU utilization, and end-to-end observability across diverse model workloads, with a