Senior AI Platform Engineer – Remote, Scalable ML Inference

Bright Vision Technologies; Franklin, Brentwood, Nashville (TN, TN, TN); Remote; USD 130.000 - 180.000; Vollzeit

Zusammenfassung

Bright Vision Technologies is seeking a highly experienced AI Platform Engineer with 10+ years of distributed systems, cloud-native infrastructure, and AI platform engineering to design, build, and operate enterprise-scale AI inference and ML platforms.

The ideal candidate will excel in LLM serving, GPU optimization, Kubernetes, and MLOps, delivering scalable, reliable, secure, and cost-efficient AI services for production workloads across multiple regions.

Qualifikationen

• 6+ years of experience in distributed systems, infrastructure, or ML platform engineering.
• Strong Python and Go, Rust, or C++ proficiency.
• Experience with LLM inference frameworks (vLLM, TensorRT-LLM), Kubernetes, cloud platforms, and GPU optimization.

Aufgaben

• Design and maintain scalable AI model serving platforms.
• Optimize inference performance, GPU utilization, and request routing.
• Build autoscaling, deployment, and monitoring solutions.
• Implement caching, security, and high-availability strategies.
• Collaborate with ML teams to deploy and support production AI models.

Kenntnisse

Distributed systems

LLM serving

GPU optimization

Kubernetes

MLOps

Python

Go

Rust

C++

Tools

vLLM

TensorRT-LLM

Kubernetes

Jobbeschreibung

Bright Vision Technologies is seeking a highly experienced AI Platform Engineer with 10+ years of distributed systems, cloud-native infrastructure, and AI platform engineering to design, build, and operate enterprise-scale AI inference and ML platforms.

The ideal candidate will excel in LLM serving, GPU optimization, Kubernetes, and MLOps, delivering scalable, reliable, secure, and cost-efficient AI services for production workloads across multiple regions.