Remote ML Platform Engineer — Scalable AI Inference

Bright Vision Technologies; Edison (NJ); Remote; USD 100,000 - 160,000; Full time

Job summary

Bright Vision Technologies is seeking an experienced ML Platform Engineer for a 100% remote role in the United States. You will design and operate high-performance inference platforms for large ML models, focusing on system reliability, latency, and cost efficiency.

The role requires 10+ years in distributed systems and strong Python plus at least one systems language (Go, Rust, or C++). Responsibilities include building scalable model serving with batching, multi-tenant routing, and

Qualifications

• Bachelor’s or Master’s in Computer Science or related field.
• 10+ years in distributed systems, infrastructure, or ML platform engineering.
• Proficient in Python and a systems language (Go, Rust, C++).
• Experience deploying high-throughput, low-latency services.

Responsibilities

• Design and operate model serving platforms for diverse ML workloads.
• Optimize inference with batching, caching, and autoscaling.
• Implement multi-tenant routing, rate limiting, and QoS policies.
• Build autoscaling and capacity management balancing latency and cost.
• Tune GPU utilization and memory management for LLM serving.
• Integrate serving with API gateways and observability platforms.
• Develop deployment workflows with canaries and rollbacks.
• Lead incident response for high-availability AI services.

Skills

Distributed systems

Python

Go

Rust

C++

Performance engineering

LLM inference

Observability

Incident response

Communication

Education

Bachelor's or Master's in Computer Science

Tools

Kubernetes

TensorRT-LLM

vcLLM

Observability stacks

Job description

Bright Vision Technologies is seeking an experienced ML Platform Engineer for a 100% remote role in the United States. You will design and operate high-performance inference platforms for large ML models, focusing on system reliability, latency, and cost efficiency.

The role requires 10+ years in distributed systems and strong Python plus at least one systems language (Go, Rust, or C++). Responsibilities include building scalable model serving with batching, multi-tenant routing, and