Remote MLOps Engineer - Scalable AI Inference Platform

Bright Vision Technologies; Sammamish (WA); On-site; USD 100,000 - 150,000; Full time

Job summary

Bright Vision Technologies in the United States is seeking an experienced MLOps Engineer to design, build, and operate high-performance ML inference platforms in production.

This role focuses on systems engineering for AI deployment, covering request routing, autoscaling, GPU utilization, observability, and end-to-end reliability.

Ideal candidates bring strong distributed systems expertise and a track record shipping serving systems at scale in a cloud environment.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or a related field.
• 6+ years of experience in distributed systems, infrastructure, or ML platform engineering.
• Strong proficiency in Python and a systemslanguage such as Go, Rust, or C++.
• Hands-on experience with LLM or large model inference frameworks such as vLLM or TensorRT-LLM.

Responsibilities

• Design and operate model serving platforms supporting diverse workloads including LLMs, vision models, and recommendation systems.
• Optimize inference performance using batching, paging, and speculative decoding techniques.
• Implement multi-tenant routing, rate limiting, and QoS policies across model endpoints.
• Build autoscaling and capacity management systems balancing latency, throughput, and cost.
• Tune GPU utilization, memory management, and KV cache strategies for LLM serving workloads.
• Integrate serving with API gateways, identity systems, and observability platforms.
• Develop deployment workflows including canary releases, shadow testing, and automated rollback.
• Drive incident response for high-availability AI services and continuous reliability improvements.
• Collaborate with ML and product teams to support new model releases and feature rollouts.
• Document operating procedures and performance guidance for internal teams.

Skills

Python

Go

Rust

C++

Kubernetes

LLM frameworks

Distributed systems

Observability

Education

Bachelor's or Master's in Computer Science or related field

Tools

vLLM

TensorRT-LLM

GPU utilization

Job description

Bright Vision Technologies in the United States is seeking an experienced MLOps Engineer to design, build, and operate high-performance ML inference platforms in production.

This role focuses on systems engineering for AI deployment, covering request routing, autoscaling, GPU utilization, observability, and end-to-end reliability.

Ideal candidates bring strong distributed systems expertise and a track record shipping serving systems at scale in a cloud environment.