Senior ML Infrastructure Engineer – Remote

Bright Vision Technologies; Redwood City, San Mateo (CA, CA); On-site; USD 105,000 - 143,000; Full time

Job summary

Bright Vision Technologies seeks a Machine Learning Infrastructure Engineer to design, build, and operate high-performance inference platforms for serving large ML models in production. The role emphasizes systems engineering for AI deployment, including routing, batching, caching, autoscaling, GPU utilization, and end-to-end observability.

Ideal candidate has distributed systems and performance engineering expertise, with experience shipping serving systems at scale and balancing latency,

Qualifications

• Bachelor's or Master's in CS or related field.
• 6+ years in distributed systems, infra, or ML platform eng.
• Strong Python and systems languages (Go/Rust/C++).

Responsibilities

• Design and operate high-performance ML inference platforms.
• Optimize latency, throughput, and cost trade-offs.
• Ensure observability across model workloads.

Skills

Distributed systems

Python

Go

Rust

C++

GPU/ML inference

Kubernetes

Observability

Performance engineering

Incident response

Education

Bachelor's or Master's in CS or related field

Tools

vLLM

TensorRT-LLM

Cloud platforms

Autoscaling

Observability stacks

Job description

Bright Vision Technologies seeks a Machine Learning Infrastructure Engineer to design, build, and operate high-performance inference platforms for serving large ML models in production. The role emphasizes systems engineering for AI deployment, including routing, batching, caching, autoscaling, GPU utilization, and end-to-end observability.

Ideal candidate has distributed systems and performance engineering expertise, with experience shipping serving systems at scale and balancing latency,