Remote ML Systems Engineer - Scalable Inference & GPUs

Bright Vision Technologies; Overland Park (KS); Remote; USD 145,000 - 165,000; Full time

Job summary

Bright Vision Technologies is seeking an ML Systems Engineer to design, build, and operate high-performance inference platforms for large ML models in production. The role emphasizes distributed systems, performance optimization, and end-to-end observability across model workloads.

The ideal candidate has deep experience in GPU-accelerated serving, latency-threat tradeoffs, and cloud-based architectures. This fully remote US-based position offers strong growth potential and direct W2 employment.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or a related field.
• Six or more years of experience in distributed systems, infrastructure, or ML platform engineering.
• Strong proficiency in Python and a systems language such as Go, Rust, or C++.
• Deep experience operating high-throughput, low-latency services in production.
• Hands-on experience with LLM or large model inference frameworks such as vLLM or TensorRT-LLM.
• Strong understanding of GPU architecture, memory hierarchies, and accelerator utilization.
• Familiarity with Kubernetes, autoscaling, and modern cloud platforms.
• Experience with observability stacks including metrics, tracing, and structured logging.
• Solid grounding in performance engineering and capacity planning.
• Strong communication and incident response skills.

Responsibilities

• Design, build, and operate high-performance inference platforms for serving large ML models.
• Focus on systems engineering aspects of AI deployment: routing, batching, caching, autoscaling, GPU utilization.
• Ensure end-to-end observability across diverse model workloads and environments.
• Balance latency, throughput, cost, and quality in production serving systems.

Skills

Python

Go

Rust

C++

Distributed systems

Kubernetes

Cloud platforms

Observability

GPUs

Performance engineering

Education

Bachelor’s or Master’s in CS

Tools

vLLM

TensorRT-LLM

Job description

Bright Vision Technologies is seeking an ML Systems Engineer to design, build, and operate high-performance inference platforms for large ML models in production. The role emphasizes distributed systems, performance optimization, and end-to-end observability across model workloads.

The ideal candidate has deep experience in GPU-accelerated serving, latency-threat tradeoffs, and cloud-based architectures. This fully remote US-based position offers strong growth potential and direct W2 employment.