Remote ML Systems Engineer - Build Production Inference

Bright Vision Technologies; Round Rock (TX); On-site; USD 145,000 - 165,000; Full time

Job summary

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.

The ML Systems Engineer role focuses on designing, building, and operating high-performance inference platforms for production ML models, with emphasis on systems engineering, request routing, batching,

Qualifications

• Bachelor’s or Master’s degree in Computer Science or a related field
• Six or more years of experience in distributed systems, infrastructure, or ML platform engineering
• Strong proficiency in Python and a systems language such as Go, Rust, or C++
• Deep experience operating high-throughput, low-latency services in production
• Hands-on experience with LLM or large model inference frameworks such as vLLM or TensorRT-LLM
• Strong understanding of GPU architecture, memory hierarchies, and accelerator utilization
• Familiarity with Kubernetes, autoscaling, and modern cloud platforms
• Experience with observability stacks including metrics, tracing, and structured logging
• Solid grounding in performance engineering and capacity planning
• Strong communication and incident response skills

Skills

Python

Go

Rust

C++

Distributed systems

Observability

Kubernetes

Autoscaling

Performance engineering

Incident response

Communication

Cloud platforms

LLM inference frameworks

Education

Bachelor’s or Master’s in CS

Tools

Kubernetes

vLLM

TensorRT-LLM

Job description

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.

The ML Systems Engineer role focuses on designing, building, and operating high-performance inference platforms for production ML models, with emphasis on systems engineering, request routing, batching,