Remote Senior AI Infrastructure Engineer

Bright Vision Technologies; Woodbridge Township (NJ); Remote; USD 100,000 - 160,000; Full time

Job summary

Bright Vision Technologies is seeking an AI Infrastructure Engineer to design, build, and operate the platform layer powering large-scale AI training and inference. You will focus on GPU clusters, distributed training, scheduling, and data pipelines to keep workloads fed efficiently.

You should have deep experience with hardware–software interaction, kernel, and ML frameworks, plus strong software engineering discipline. This is a remote, full-time role with competitive compensation.

Qualifications

• 10+ years in infra, platform, or HPC engineering.
• Hands-on GPU clusters / ML training infra.
• Proficient in Python and a systems language (Go/C++).
• Distributed training, accelerator architectures, and collective communication.
• Experience with ML frameworks scheduling (Kubernetes, Slurm, Ray).
• Strong Linux, networking, and high-performance storage knowledge.
• Experience with a major cloud provider’s ML infra offerings.
• Solid testing, CI/CD, and code-review practices.

Responsibilities

• Design and operate GPU and accelerator infrastructure for training and inference across on‑prem, cloud, and hybrid setups.
• Build scheduling, queueing, and resource-sharing systems to maximize utilization.
• Integrate PyTorch, JAX, DeepSpeed, FSDP, Megatron-LM, and Ray Train into a unified platform.
• Operate high-performance storage and data pipelines to feed accelerators at near line rate.
• Design networking architectures with RDMA, InfiniBand, NCCL and high‑bandwidth comms.
• Build observability for AI workloads including utilization, throughput, and failure analysis.
• Implement checkpointing, restart, and fault-tolerance for long-running training jobs.
• Drive cost optimization via scheduling, spot capacity, and right-sizing.
• Develop tooling and paved-road workflows for safe, scalable experiments.
• Collaborate with research/ML teams to plan capacity for upcoming runs.
• Enforce security controls and multi-tenant isolation across the platform.
• Automate cluster provisioning, lifecycle management, and config enforcement.
• Maintain runbooks, dashboards, and operational docs; stay current with AI infra trends.

Skills

Python

Go/C++

Distributed training

GPU cluster ops

Kubernetes

Ray

CI/CD

Linux internals

Education

Bachelor’s or Master’s degree

Tools

Slurm

NCCL

RDMA

Megatron-LM

Job description

Bright Vision Technologies is seeking an AI Infrastructure Engineer to design, build, and operate the platform layer powering large-scale AI training and inference. You will focus on GPU clusters, distributed training, scheduling, and data pipelines to keep workloads fed efficiently.

You should have deep experience with hardware–software interaction, kernel, and ML frameworks, plus strong software engineering discipline. This is a remote, full-time role with competitive compensation.