Senior ML Infra Engineer – Remote

Bright Vision Technologies; United States; À distance; USD 105 000 - 143 000; Plein temps

Résumé du poste

Bright Vision Technologies is seeking a Machine Learning Infrastructure Engineer to design, build, and operate high-performance inference platforms for serving large ML models. This role emphasizes distributed systems, observability, and efficient GPU utilization in production environments.

The ideal candidate will have 6+ years in ML infrastructure, expertise in Python and system languages, and hands-on experience with LLM inference frameworks such as vLLM or TensorRT-LLM, plus Kubernetes and

Qualifications

• Bachelor’s or Master’s degree in CS or related field.
• 6+ years of experience in distributed systems or ML infrastructure.
• Proficient in Python and a systems language (Go, Rust, or C++).
• Experience running high-throughput, low-latency services in production.
• Hands-on with LLM inference frameworks like vLLM or TensorRT-LLM.
• Strong knowledge of GPU architecture and accelerator utilization.
• Kubernetes, autoscaling, and cloud platforms experience.
• Observability stacks (metrics, tracing, logging).
• Excellent communication and incident response skills.

Connaissances

Python

Distributed systems

Go/Rust/C/C++

Performance engineering

Observability

Kubernetes

Formation

Bachelor’s or Master’s degree in Computer Science or related field

Outils

Kubernetes

TensorRT-LLM

vLLM

Cloud platforms

Description du poste

Bright Vision Technologies is seeking a Machine Learning Infrastructure Engineer to design, build, and operate high-performance inference platforms for serving large ML models. This role emphasizes distributed systems, observability, and efficient GPU utilization in production environments.

The ideal candidate will have 6+ years in ML infrastructure, expertise in Python and system languages, and hands-on experience with LLM inference frameworks such as vLLM or TensorRT-LLM, plus Kubernetes and