Senior Compute Platform Engineer: GPU & Bare-Metal

Moonlite

United States

Remote

USD 165,000 - 225,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Startup equity
Industry-leading benefits
Competitive compensation

Job summary

Moonlite delivers high-performance AI infrastructure for researchers and enterprises, providing on-demand or reserved compute in facilities or customer sites. You will help build a GPU-accelerated compute platform powering distributed AI training and inference, collaborating with product and infrastructure specialists to design the orchestration layer for GPU clusters and bare-metal provisioning.

You will implement scheduling, multi-tenant isolation, and scalable APIs while optimizing for

Qualifications

  • 5+ years in software engineering building compute platforms.
  • Experience with container orchestration at scale.
  • Strong Kubernetes knowledge and operations.
  • Proficient in Go, C/C++, Python, or Rust.
  • Linux systems programming and performance optimization.
  • Experience with virtualization (KVM, Xen) and multi-tenant GPU sharing.
  • Experience with bare-metal provisioning and hardware abstraction.
  • Excellent problem solving and architecture skills.
  • Strong communication and autonomy.

Responsibilities

  • Design and build scalable compute orchestration platforms for GPU clusters and bare-metal provisioning.
  • Implement intelligent workload scheduling and resource allocation for research workloads.
  • Provision and manage Kubernetes and SLURM clusters for distributed AI training.
  • Develop platform capabilities for NVIDIA GPU configurations and multi-tenant isolation.
  • Automate bare-metal lifecycle management from provisioning to updates.
  • Optimize performance for high-throughput, low-latency workloads in virtualized environments.
  • Create robust APIs/SDKs to provision compute resources programmatically.
  • Implement observability and monitoring for GPU virtualization and health.
  • Ensure secure, compliant multi-tenant sharing across teams.

Skills

Go
C/C++
Python
Kubernetes
Linux
GPU computing
Container orchestration
Terraform
gRPC

Tools

KVM
Docker
NVIDIA GPUDirect
SR-IOV
CUDA
InfiniBand
Terraform

Job description

Moonlite delivers high-performance AI infrastructure for researchers and enterprises, providing on-demand or reserved compute in facilities or customer sites. You will help build a GPU-accelerated compute platform powering distributed AI training and inference, collaborating with product and infrastructure specialists to design the orchestration layer for GPU clusters and bare-metal provisioning.

You will implement scheduling, multi-tenant isolation, and scalable APIs while optimizing for

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Compute Platform Engineer - Remote AI Infrastructure
Senior Compute Platform Engineer - Remote AI Infrastructure

NEPSE Trading • United States

Hybrid
USD 165,000 - 225,000
Senior Software Engineer, Compute Platform
Senior Software Engineer, Compute Platform

NEPSE Trading • United States

Hybrid
USD 165,000 - 225,000
Senior AI Infra Platform Engineer
Senior AI Infra Platform Engineer

Moonlite • United States

On-site
USD 165,000 - 225,000
Startup equity
Fully covered health insurance
6% 401(k) match
+1
Senior Software Engineer, Compute Platform
Senior Software Engineer, Compute Platform

Moonlite • United States

Remote
USD 165,000 - 225,000
Startup equity
Industry-leading benefits
Competitive compensation
Senior Network Platform Engineer — AI Infrastructure
Senior Network Platform Engineer — AI Infrastructure

Moonlite • United States

On-site
USD 180,000 - 260,000
Competitive salary with equity
On-the-job training and mentorship
Career development opportunities
+3
Senior AI Platform Engineer — GPU Serving & Telemetry
Senior AI Platform Engineer — GPU Serving & Telemetry

Code Metal • United States

Hybrid
USD 150,000 - 190,000
Health care plan (Medical, Dental &amp
401k/IRA Retirement plan
Flexible hybrid work arrangement
+2
Senior GPU Infrastructure Engineer: Schedulers & ML Infra
Senior GPU Infrastructure Engineer: Schedulers & ML Infra

Career Movement • San Francisco (CA)

On-site
USD 180,000 - 240,000
Senior Backend Engineer - GPU Cloud Platform
Senior Backend Engineer - GPU Cloud Platform

Lightning AI • San Francisco (CA), Seattle (WA), New York (NY)

Hybrid
USD 180,000 - 250,000
Comprehensive Health Coverage
Meaningful Equity
401(k) matching
+3
GPU Bare-Metal Infra Engineer (Bay Area)
GPU Bare-Metal Infra Engineer (Bay Area)

Metric • San Francisco (CA)

On-site
USD 180,000 - 240,000
Senior Software Engineer, Platform Infrastructure
Senior Software Engineer, Platform Infrastructure

Moonlite • United States

On-site
USD 165,000 - 225,000
Startup equity
Fully covered health insurance
6% 401(k) match
+1