Remote ML Inference Platform Engineer

Bright Vision Technologies; Orlando (FL); Remote; USD 100,000 - 150,000; Full time

Job summary

Bright Vision Technologies is seeking a Data Platform Engineer to design, build, and operate high-performance ML serving platforms for production workloads. The role emphasizes systems engineering for AI deployment, including routing, batching, caching, autoscaling, and GPU utilization, with strong observability across diverse model workloads.

The ideal candidate has 6+ years in distributed systems or ML platforms, deep Python and systems language skills (Go/Rust/C++), and hands-on experience

Qualifications

• Bachelor’s or Master’s degree in CS or related field.
• 6+ years of experience in distributed systems, infrastructure, or ML platform engineering.
• Strong proficiency in Python and a systems language such as Go, Rust, or C++.
• Deep experience operating high-throughput, low-latency services in production.
• Hands-on experience with LLM or large model inference frameworks such as vLLM or TensorRT-LLM.
• Strong understanding of GPU architecture, memory hierarchies, and accelerator utilization.
• Familiarity with Kubernetes, autoscaling, and modern cloud platforms.
• Experience with observability stacks including metrics, tracing, and structured logging.
• Solid grounding in performance engineering and capacity planning.
• Strong communication and incident response skills.

Responsibilities

• Design, build, and operate high-performance ML serving platforms.
• Focus on systems engineering for AI deployment including routing, batching, caching, and autoscaling.
• Optimize latency, throughput, cost, and quality in ML serving.
• Ensure end-to-end observability across model workloads.
• Collaborate with ML researchers and platform engineers to scale serving.

Skills

Python

Go

Rust

C++

Distributed systems

LLM inference

GPU acceleration

Kubernetes

Autoscaling

Cloud platforms

Observability

Performance engineering

Incident response

Education

Bachelor’s or Master’s degree in Computer Science or related field

Six+ years of experience in distributed systems / ML platform engineering

Tools

Kubernetes

Job description

Bright Vision Technologies is seeking a Data Platform Engineer to design, build, and operate high-performance ML serving platforms for production workloads. The role emphasizes systems engineering for AI deployment, including routing, batching, caching, autoscaling, and GPU utilization, with strong observability across diverse model workloads.

The ideal candidate has 6+ years in distributed systems or ML platforms, deep Python and systems language skills (Go/Rust/C++), and hands-on experience