Remote ML Infrastructure Engineer - Scalable AI Serving

Bright Vision Technologies; San Diego, 4S Ranch (CA, CA); Remote; USD 105,000 - 143,000; Full time

Job summary

Bright Vision Technologies is seeking a Machine Learning Infrastructure Engineer to design, build, and operate high-performance inference platforms for large ML models in production. This role emphasizes systems engineering for AI deployment—routing, batching, caching, autoscaling, GPU utilization, and end-to-end observability across workloads.

The ideal candidate has strong distributed systems and performance engineering experience, and a track record shipping scalable ML serving systems.

Qualifications

• Bachelor's or Master's degree in Computer Science or related field.
• Six or more years of experience in distributed systems, infrastructure, or ML platform engineering.
• Strong proficiency in Python and a systems language such as Go, Rust, or C++.
• Hands-on experience with LLM or large model inference frameworks such as vLLM or TensorRT-LLM.
• Strong understanding of GPU architecture, memory hierarchies, and accelerator utilization.
• Familiarity with Kubernetes, autoscaling, and modern cloud platforms.
• Experience with observability stacks including metrics, tracing, and structured logging.
• Solid grounding in performance engineering and capacity planning.
• Strong communication and incident response skills.

Responsibilities

• Design, build, and operate high-performance inference platforms for production ML models.
• Own request routing, batching, caching, autoscaling, and GPU utilization.
• Ensure end-to-end observability across diverse model workloads.
• Balance latency, throughput, and cost while maintaining reliability.

Skills

Distributed systems

Performance engineering

Observability

Capacity planning

Incident response

Python

Go

Rust

C++

Education

Bachelor's or Master's in Computer Science or related field

Tools

vLLM

TensorRT-LLM

Kubernetes

Autoscaling

Cloud platforms

Observability stacks

Job description

Bright Vision Technologies is seeking a Machine Learning Infrastructure Engineer to design, build, and operate high-performance inference platforms for large ML models in production. This role emphasizes systems engineering for AI deployment—routing, batching, caching, autoscaling, GPU utilization, and end-to-end observability across workloads.

The ideal candidate has strong distributed systems and performance engineering experience, and a track record shipping scalable ML serving systems.