Senior Compute Platform Engineer - Remote AI Infrastructure

NEPSE Trading; Northern (KY); Hybrid; USD 165,000 - 225,000; Full time

Job summary

Moonlite is hiring a Senior Software Engineer to build and operate a GPU-accelerated compute platform supporting distributed AI training and HPC workloads. You will design orchestration layers, provision bare-metal resources, and enable programmatic access to high-performance compute infrastructure.

You will work with Go, C/C++, Python, or Rust on performance-critical components, and collaborate across product, platform, and infrastructure teams to optimize GPU utilization and scalability.

Qualifications

• 5+ years in software engineering building compute platforms or distributed compute infrastructure.
• Strong background in compute orchestration, resource scheduling, or workload management at scale.
• Familiarity with Kubernetes architecture and deploying workloads in Kubernetes environments.

Responsibilities

• Design and build scalable compute orchestration platforms for GPU clusters and bare-metal provisioning.
• Develop intelligent scheduling and resource allocation to maximize GPU utilization.
• Provision and manage research computing environments including Kubernetes and SLURM clusters for AI training and HPC workloads.
• Develop platform capabilities for managing NVIDIA GPU configurations and multi-tenant isolation.
• Automate bare-metal lifecycle management from provisioning to updates and reallocation.
• Build robust APIs and SDKs for programmatic control of compute resources.
• Implement monitoring and telemetry for compute resources and GPU virtualization.
• Support multi-tenant isolation and strict security boundaries for shared GPU infrastructure.

Skills

Compute platforms

Kubernetes

SLURM

Go

C/C++

Python

Rust

Linux

KVM

NVIDIA vGPU

CUDA

InfiniBand

RDMA

Terraform

FastAPI

gRPC

Tools

Docker

Terraform

FastAPI

gRPC

Job description

Moonlite is hiring a Senior Software Engineer to build and operate a GPU-accelerated compute platform supporting distributed AI training and HPC workloads. You will design orchestration layers, provision bare-metal resources, and enable programmatic access to high-performance compute infrastructure.

You will work with Go, C/C++, Python, or Rust on performance-critical components, and collaborate across product, platform, and infrastructure teams to optimize GPU utilization and scalability.