Senior AI Platform Engineer | Cloud-Native MLOps (Remote)

Bright Vision Technologies; United States; Remote; USD 130,000 - 180,000; Full time

Job summary

Bright Vision Technologies seeks an experienced AI Platform Engineer to design, build, and operate enterprise-scale AI inference platforms. The role emphasizes distributed systems, cloud-native infrastructure, and scalable model serving for production workloads.

The ideal candidate has 10+ years in the field, deep expertise in LLM serving, GPU optimization, Kubernetes, and MLOps, with strong collaboration across AI researchers, ML engineers, and DevOps teams.

Qualifications

• 10+ years of professional experience in distributed systems, cloud-native infrastructure, or ML platform engineering.
• Strong programming skills in Python and at least one of Go, Rust, or C++.
• Extensive experience with Large Language Model (LLM) serving and production AI infrastructure.
• Hands-on experience with vLLM, TensorRT-LLM, Triton Inference Server, Ray Serve, or similar AI serving frameworks.
• Strong Kubernetes expertise, container orchestration, Docker, and cloud-native architectures.
• Experience optimizing GPU workloads with CUDA and NVIDIA technologies.
• Experience with AWS, Azure, or Google Cloud Platform (GCP).
• Excellent analytical and communication skills; able to lead technically.

Responsibilities

• Design, build, and maintain scalable AI inference and model-serving platforms for enterprise production environments.
• Architect highly available, cloud-native infrastructure supporting Large Language Models (LLMs), foundation models, and machine learning services.
• Optimize inference latency, throughput, GPU utilization, memory management, and request scheduling across distributed AI workloads.
• Design autoscaling, workload orchestration, traffic management, and intelligent request routing strategies for AI services.
• Implement model deployment, versioning, rollback, and lifecycle management using modern MLOps practices.
• Develop monitoring, observability, logging, distributed tracing, and alerting solutions to ensure platform reliability and performance.
• Implement caching strategies, API gateways, security controls, authentication, authorization, and high-availability architectures.
• Collaborate with AI researchers, ML engineers, DevOps teams, and software engineers to deploy and support production AI models.
• Drive cloud infrastructure optimization, resource utilization, FinOps initiatives, and operational excellence.
• Mentor engineering teams, conduct architecture reviews, and establish best practices for AI platform engineering and cloud-native development.
• Evaluate emerging AI infrastructure technologies, model-serving frameworks, and GPU acceleration techniques to drive continuous innovation.

Skills

Python

Go

Rust

C++

LLM serving

Kubernetes

CUDA

GPU optimization

AWS

Azure

GCP

MLOps

Education

Bachelor's or Master’s in CS/CE/AI or related

Tools

vLLM

TensorRT-LLM

Triton Inference Server

Ray Serve

Job description

Bright Vision Technologies seeks an experienced AI Platform Engineer to design, build, and operate enterprise-scale AI inference platforms. The role emphasizes distributed systems, cloud-native infrastructure, and scalable model serving for production workloads.

The ideal candidate has 10+ years in the field, deep expertise in LLM serving, GPU optimization, Kubernetes, and MLOps, with strong collaboration across AI researchers, ML engineers, and DevOps teams.