AI Platform Engineer

Bright Vision Technologies; Powell (OH); Remote; USD 140,000 - 210,000; Full time

Job summary

Bright Vision Technologies is seeking an AI Platform Engineer to design, build, and operate scalable AI inference platforms for production ML workloads. The role emphasizes distributed systems, LLM serving, GPU optimization, and cloud-native infrastructure to deliver reliable, cost-efficient AI platforms.

The ideal candidate has 10+ years of experience in distributed systems and AI platform engineering, with deep expertise in Kubernetes, cloud infrastructure, and MLOps.

Qualifications

• Requires 6+ years in distributed systems, infra, or ML platform eng.
• Proficient in Python and at least one systems language (Go/Rust/C++).
• Extensive experience with LLM serving and production AI infra.

Responsibilities

• Design and maintain scalable AI model serving platforms.
• Optimize inference performance and GPU utilization.
• Build autoscaling, deployment, and monitoring solutions.
• Collaborate with ML teams to deploy production AI models.
• Architect cloud-native infrastructure for LLMs and ML services.
• Develop observability, tracing, and alerting for reliability.
• Mentor teams and promote AI platform engineering best practices.

Skills

Distributed systems

Python

Go

Rust

C++

Kubernetes

Cloud platforms

GPU optimization

LLM serving

MLOps

Observability

FinOps

Multi-region deployments

Education

Bachelor's or Master's in CS/CE/AI

Tools

vLLM

TensorRT-LLM

Triton Inference Server

Ray Serve

Docker

Kubernetes

Job description

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.

Position Summary

Job Title: AI Platform Engineer

Location

100% Remote (Continental United States)

Contract Type

Full-time, Direct W2

Eligibility / Sponsorship

Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.

Job Overview

We are seeking an AI Platform Engineer to design, build, and operate scalable AI inference platforms for production ML workloads. The ideal candidate will have expertise in distributed systems, LLM serving, GPU optimization, autoscaling, and cloud-native infrastructure, with a strong focus on performance, reliability, and observability. Bright Vision Technologies is seeking a highly experienced AI Platform Engineer with 10+ years of experience in distributed systems, cloud-native infrastructure, and AI platform engineering to design, build, and operate enterprise-scale AI inference and machine learning platforms. The ideal candidate will possess deep expertise in LLM serving, GPU optimization, Kubernetes, cloud infrastructure, distributed systems, and MLOps, with a proven ability to deliver highly scalable, reliable, secure, and cost-efficient AI platforms supporting production machine learning workloads.

Responsibilities

• Design and maintain scalable AI model serving platforms.
• Optimize inference performance, GPU utilization, and request routing.
• Build autoscaling, deployment, and monitoring solutions.
• Collaborate with ML teams to deploy and support production AI models.
• Design, build, and maintain scalable AI inference and model-serving platforms for enterprise production environments.
• Architect highly available, cloud-native infrastructure supporting Large Language Models (LLMs), foundation models, and machine learning services.
• Optimize inference latency, throughput, GPU usage, memory management, and request scheduling across distributed AI workloads.
• Design autoscaling, workload orchestration, traffic management, and intelligent request routing strategies for AI services.
• Implement model deployment, versioning, rollback, and lifecycle management using modern MLOps practices.
• Develop monitoring, observability, logging, distributed tracing, and alerting solutions to ensure platform reliability and performance.
• Collaborate with AI researchers, ML engineers, DevOps teams, and software engineers to deploy and support production AI models.
• Drive cloud infrastructure optimization, resource utilization, FinOps initiatives, and operational excellence.
• Mentor engineering teams, conduct architecture reviews, and establish best practices for AI platform engineering and cloud-native development.
• Evaluate emerging AI infrastructure technologies, model-serving frameworks, and GPU acceleration techniques to drive continuous innovation.
• Contribute to open-source AI infrastructure projects, technical publications, patents, or conference presentations.
• Experience implementing FinOps strategies, cloud cost optimization, and enterprise AI governance.
• Experience with multi-region AI deployments and AI infrastructure.
• Open-source contributions or experience supporting large-scale AI APIs.

Qualifications

• 6+ years of experience in distributed systems, infrastructure, or ML platform engineering.
• ~ Strong proficiency in Python and Go, Rust, or C++.
• ~ Experience with LLM inference frameworks (vLLM, TensorRT-LLM), Kubernetes, cloud platforms, and GPU optimization.
• ~10+ years of professional experience in distributed systems, infrastructure engineering, cloud platforms, or machine learning platform engineering.
• ~ Strong programming skills in Python and at least one systems programming language such as Go, Rust, or C++ .
• ~ Extensive experience with Large Language Model (LLM) serving , model inference optimization, and production AI infrastructure.
• ~ Hands‑on experience with vLLM, TensorRT‑LLM, Triton Inference Server, Ray Serve, or similar AI serving frameworks .
• ~ Strong expertise in Kubernetes , container orchestration, Docker, and cloud‑native application architectures.
• ~ Experience optimizing GPU workloads using CUDA , NVIDIA GPU technologies, distributed inference, and high‑performance AI infrastructure.
• ~ Experience with cloud platforms including AWS, Microsoft Azure, or Google Cloud Platform (GCP) .
• ~ Strong understanding of distributed systems, networking, scalability, observability, and security best practices.
• ~ Experience designing and operating multi‑region AI platforms and globally distributed inference services.

Education

Bachelor's or Master's degree in Computer Science, Computer Engineering, Artificial Intelligence, or a related technical discipline.

Equal Employment Opportunity

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.