Remote ML Infra Engineer - High-Performance Inference

Bright Vision Technologies; Mountain View (CA); On-site; USD 105,000 - 143,000; Full time

Job summary

Bright Vision Technologies is seeking a Machine Learning Infrastructure Engineer to design, build, and operate high-performance inference platforms for serving large ML models in production. This remote U.S.

role focuses on the systems engineering side of AI deployment, including routing, batching, caching, autoscaling, GPU utilization, and end-to-end observability. The ideal candidate has 6+ years in distributed systems or ML infrastructure, strong Python and systems language skills (Go, Rust,

Qualifications

• Bachelor’s or Master’s degree in Computer Science or a related field.
• Six or more years of experience in distributed systems, infrastructure, or ML platform engineering.
• Strong proficiency in Python and a systems language such as Go, Rust, or C++.
• Deep experience operating high-throughput, low-latency services in production.
• Hands‑on experience with LLM or large model inference frameworks such as vLLM or TensorRT‑LLM.
• Strong understanding of GPU architecture, memory hierarchies, and accelerator utilization.
• Familiarity with Kubernetes, autoscaling, and modern cloud platforms.
• Experience with observability stacks including metrics, tracing, and structured logging.
• Solid grounding in performance engineering and capacity planning.
• Strong communication and incident response skills.

Responsibilities

• Design, build, and operate high-performance inference platforms for serving large ML models in production.
• Focus on systems engineering of AI deployment, including routing, batching, caching, autoscaling, and GPU utilization.
• Ensure end-to-end observability across diverse model workloads.
• Balance latency, throughput, cost, and quality trade-offs while shipping at scale.

Skills

Distributed systems

Performance engineering

Incident response

Communication

Cloud platforms

GPU architecture

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

Python

Go

Rust

C++

Kubernetes

TensorRT-LLM

vLLM

Job description

Bright Vision Technologies is seeking a Machine Learning Infrastructure Engineer to design, build, and operate high-performance inference platforms for serving large ML models in production. This remote U.S.

role focuses on the systems engineering side of AI deployment, including routing, batching, caching, autoscaling, GPU utilization, and end-to-end observability. The ideal candidate has 6+ years in distributed systems or ML infrastructure, strong Python and systems language skills (Go, Rust,