Senior AI Platform Engineer - Remote AI Inference & Infra

Bright Vision Technologies; Oregon; Hybrid; USD 130,000 - 180,000; Full time

Job summary

Bright Vision Technologies seeks an AI Platform Engineer with 10+ years in distributed systems, cloud-native infrastructure, and AI platform engineering to design, build, and operate enterprise-scale AI inference platforms.

The role emphasizes LLM serving, GPU optimization, Kubernetes, and MLOps, collaborating with researchers, DevOps, and software engineers to deliver scalable, secure AI workloads.

Qualifications

• Bachelor's or Master's degree in a technical field.
• 10+ years in distributed systems or ML platform engineering.
• Strong programming in Python and at least one systems language.
• Extensive experience with LLM serving and AI infrastructure.
• Experience with Kubernetes and cloud platforms.

Responsibilities

• Design and maintain scalable AI inference and model-serving platforms.
• Architect cloud-native infra for LLMs and foundation models.
• Optimize latency, throughput, and GPU utilization.
• Implement autoscaling, routing, and MLOps practices.
• Develop monitoring and observability for the platform.
• Collaborate with researchers, DevOps, and software engineers.

Skills

Distributed systems

Cloud platforms

Python

Go

Rust

C++

Leadership

Communication

Education

Bachelor's or Master's in CS/Engineering

Tools

Kubernetes

Docker

Ray Serve

Triton Inference Server

LLM serving frameworks

Job description

Bright Vision Technologies seeks an AI Platform Engineer with 10+ years in distributed systems, cloud-native infrastructure, and AI platform engineering to design, build, and operate enterprise-scale AI inference platforms.

The role emphasizes LLM serving, GPU optimization, Kubernetes, and MLOps, collaborating with researchers, DevOps, and software engineers to deliver scalable, secure AI workloads.