Remote ML Infrastructure Engineer: GPU Scale & Platform

Bright Vision Technologies; Sammamish (WA); On-site; USD 100,000 - 150,000; Full time

Job summary

Bright Vision Technologies is seeking an AI Infrastructure Engineer to design, build, and operate the platform layer powering large-scale AI training and inference. This role focuses on GPU clusters, scheduling, storage, and developer experience for ML engineers and researchers, with emphasis on reliability and cost control.

The ideal candidate brings production AI infra experience, understands hardware to ML framework interactions, and applies strong software engineering discipline to platform

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field.
• Six or more years of infrastructure or HPC engineering experience.
• Hands-on experience with GPU clusters or large-scale ML training.
• Proficiency in Python and at least one systems language such as Go or C++.
• Experience with Kubernetes, Slurm, Ray, or similar ML scheduling tools.

Responsibilities

• Design and operate GPU and accelerator infrastructure for training and inference.
• Build scheduling and resource-sharing systems to maximize accelerator utilization.
• Integrate PyTorch, JAX, DeepSpeed, FSDP, Megatron-LM, and Ray Train into a platform.
• Operate high-performance storage and data pipelines for training data.
• Design networking architectures with RDMA, InfiniBand, NCCL.
• Develop observability and reliability for AI workloads.
• Implement checkpointing and fault-tolerance for long-running jobs.
• Drive cost optimization across compute, storage, and networking.
• Develop developer tooling to enable researchers to run experiments safely.
• Plan capacity with research teams and manage multi-tenant access control.
• Automate cluster provisioning and maintain runbooks and dashboards.

Skills

Python proficiency

Go or C++

Linux internals

Distributed systems

CI/CD practices

Communication skills

Education

Bachelor’s or Master’s degree in Computer Science

Tools

Kubernetes

Slurm

Ray

PyTorch

DeepSpeed

Job description

Bright Vision Technologies is seeking an AI Infrastructure Engineer to design, build, and operate the platform layer powering large-scale AI training and inference. This role focuses on GPU clusters, scheduling, storage, and developer experience for ML engineers and researchers, with emphasis on reliability and cost control.

The ideal candidate brings production AI infra experience, understands hardware to ML framework interactions, and applies strong software engineering discipline to platform