Senior Software Engineer, Platform Infrastructure

Moonlite

United States

On-site

USD 165,000 - 225,000

Full time

7 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Startup equity
Fully covered health insurance
6% 401(k) match
Comprehensive benefits

Job summary

Moonlite in the United States builds the infrastructure behind ambitious AI. As a Platform Engineer, you will design and implement the orchestration layer that unifies bare-metal servers, GPU clusters, high-performance storage, and networking into a programmable platform for large-scale AI training and HPC workloads.

You’ll collaborate with product and infrastructure teams to deliver API-driven tooling, automate deployment, and ensure security and observability across the fleet.

Qualifications

  • 5+ years in software engineering with infrastructure platforms
  • Experience with Kubernetes and container orchestration in production
  • Strong understanding of infrastructure fundamentals including compute, storage and networking
  • Proficiency in systems programming languages (Go, C/C++, Rust, Python)
  • Linux production experience including admin, performance tuning, and troubleshooting
  • Knowledge of bare-metal provisioning, virtualization and out-of-band management
  • Experience designing APIs, SDKs and automation for infrastructure management
  • Cloud platform knowledge and translating cloud-native patterns to bare-metal
  • Experience with IaC tools (Terraform, Ansible) and deployment pipelines
  • Problem solving, autonomy and clear communication in cross-team contexts
  • Growth mindset with focus on learning and professional development

Responsibilities

  • Infrastructure Abstraction Layer: bridge physical infrastructure with customer-facing services for programmatic management
  • Research Cluster Provisioning: provision and manage Kubernetes and SLURM environments for AI training and HPC workloads
  • Platform Orchestration: coordinate compute, storage, and networking for unified platform experiences
  • Network Automation & Placement: automate network provisioning and intelligent VM placement
  • Enterprise APIs & SDKs: develop APIs and SDKs for infrastructure provisioning
  • Observability & Telemetry: implement logging and monitoring across the stack
  • Performance Engineering: optimize high-throughput, low-latency networking for demanding workloads
  • Cross-Team Collaboration: align with product, engineering and infra teams on requirements and rollout
  • Compliance & Security: SOC 2, ISO 27001 alignment, audit logging and data residency management

Skills

Self-starter
Strong communication
Growth mindset
Problem solving

Tools

Go
Python
Kubernetes
Docker
Terraform
Ansible
Linux
Networking
Storage Systems
FastAPI
PostgreSQL
Redis
NVIDIA GPU Technologies
InfiniBand

Job description

Moonlite builds the infrastructure behind ambitious AI.

We design, deploy, and operate high-performance GPU systems for large-scale model training, computational research, and intensive data workloads. We combine bare-metal performance with the reliability and simplicity teams expect from the cloud.

What’s next in AI needs matching infrastructure. We’re building the team to make it happen.

Your Role

You will be foundational to building the comprehensive infrastructure platform that bridges our physical infrastructure – bare-metal servers, GPU clusters, high-performance storage, and networking fabric – with the systems our customers depend on for large-scale computation, inference, simulations, and training. Working closely with product, your platform team members, and infrastructure specialists, you’ll design and implement the orchestration layer, APIs, and automation framework that make thousands of servers, petabytes of storage, and high-speed networks feel like a unified, programmable platform.

Job Responsibilities
  • Infrastructure Abstraction Layer: Design and build systems that bridge physical infrastructure (bare-metal servers, storage clusters, network fabric) with customer-facing services, enabling programmatic management of compute, networking, and storage at scale.
  • Research Cluster Provisioning: Design and implement systems for provisioning and managing research computing environments including Kubernetes and SLURM clusters, enabling automated deployment, resource scheduling, and workload orchestration for distributed AI training and HPC workloads.
  • Platform Orchestration: Implement comprehensive orchestration systems that coordinate across compute, storage and networking to deliver unified experience for complex research workloads.
  • Network Automation & Placement: Design and build network provisioning automation including intelligent VM placement decisions for optimal network topology, automated VLAN and subnet configuration, and software-designed networking orchestration for high-performance interconnects.
  • Enterprise APIs & SDKs: Develop robust APIs and SDKs that enable researchers and engineering teams to programmatically provision and manage infrastructure resources across all platform domains.
  • Observability & Telemetry: Implement comprehensive observability, telemetry, and logging systems that provide visibility into infrastructure health, performance, and utilization across the infrastructure footprint.
  • Performance Engineering: Build and optimize platform services that deliver consistent high-throughput low-latency networking for demand research applications and data-intensive workloads.
  • Cross-Team Collaboration: Work closely with engineering, infrastructure, and product to define requirements, drive infrastructure-product-rollouts, and improve resource lifecycle management.
  • Compliance & Security: Implement platform-wide compliance and security features supporting SOC 2, ISO 27001, and enterprise regulatory requirements including comprehensive audit logging, access controls, and data residency management.
Requirements
  • Experience: 5+ years in software engineering with a proven track record of infrastructure platforms, distributed systems, or cloud platforms for production environments.
  • Kubernetes & Container Orchestration: Strong familiarity with Kubernetes architecture, container orchestration concepts, and experience deploying workloads in Kubernetes environments. Understanding of pods, deployments, services, and basic Kubernetes operations.
  • Infrastructure Systems: Strong understanding of infrastructure fundamentals including compute orchestration, storage systems, networking technologies, and how they integrate together to deliver complete platform experiences.
  • Programming Skills: Experience with systems programming languages (Go, C/C++, Rust, Python) for performance-critical components is a strong plus.
  • Linux Production Experience: Strong experience with linux in production environments, including systems administration, performance tuning, and troubleshooting.
  • Bare-Metal & Virtualization: Deep knowledge of bare-metal infrastructure, provisioning systems, out-of-band management, and virtualization technologies (KVM, Kubernetes, etc).
  • API & Platform Design: Proven experience designing and building APIs, SDKs, and automation frameworks that enable programmatic infrastructure management.
  • Cloud Platform Knowledge: Strong familiarity with cloud environments (AWS, GCP, Azure) and understanding of how to translate cloud-native patterns to bare-metal infrastructure.
  • Infrastructure Automation: Experience with Infrastructure-as-code tools (Terraform, Ansible) and building automated deployment pipelines.
  • Problem Solving & Autonomy: Self-starter who can navigate ambiguity, balance pragmatic shipping with good long-term architecture, and independently drive complex technical initiatives.
  • Communication Skills: Strong written and verbal communication skills, including ability to write clear technical communication and collaborate across teams.
  • Commitment to Growth: Growth mindset with continuous focus on learning and professional development.
Preferred Qualifications
  • Background provisioning or managing research computing environments (Kubernetes, SLURM, or HPC clusters)
  • Experience building internal platforms, infrastructure-as-a-service, or developer tooling
  • Background with GPU computing platforms and AI/ML infrastructure requirements
  • Knowledge of high-performance networking technologies (InfiniBand, RDMA, SR-IOV)
  • Experience with observability and monitoring platforms (Prometheus, Grafana, ELK stack)
  • Familiarity with both cloud-native and bare-metal infrastructure deployment models
  • Understanding of enterprise compliance requirements and security best practices
  • Extra points for experience with financial services technology infrastructure and understanding of trading system requirements.
Key Technologies
  • Go, Python, Kubernetes, Docker, Terraform, Ansible, Linux, Networking (BGP, VXLAN), Storage Systems, FastAPI, PostgreSQL, Redis, NVIDIA GPU Technologies, InfiniBand
Why Moonlite
  • Build Next-Generation Infrastructure: Your work will create the platform foundation that enables financial institutions to harness AI capabilities previously impossible with traditional infrastructure.
  • Hands-On Ownership: As an early engineer, you’ll have end-to-end ownership of projects and the autonomy to influence our product and technology direction.
  • Shape Industry Standards: Contribute to defining how enterprise AI infrastructure should work for the most demanding regulated environments.
  • Collaborate with Experts: Work alongside seasoned engineers and industry professionals passionate about high-performance computing, innovation, and problem-solving.
  • Start-Up Agility with Industry Impact: Enjoy the dynamic, fast-paced environment of a startup while making an immediate impact in an evolving and critical technology space.

We offer a competitive total compensation package combining a competitive base salary, startup equity, and industry-leading benefits. The total compensation range for this role is $165,000 – $225,000, which includes both base salary and equity. Actual compensation will be determined based on experience, skills, and market alignment. We provide generous benefits, including a 6% 401(k) match, fully covered health insurance premiums, and other comprehensive offerings to support your well-being and success as we grow together.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer, Compute Platform
Senior Software Engineer, Compute Platform

Moonlite • United States

Remote
USD 165,000 - 225,000
Startup equity
Industry-leading benefits
Competitive compensation
Senior Software Engineer, Network Platform
Senior Software Engineer, Network Platform

Moonlite • United States

On-site
USD 180,000 - 260,000
Competitive salary with equity
On-the-job training and mentorship
Career development opportunities
+3
Senior Software Engineer, Compute Platform
Senior Software Engineer, Compute Platform

NEPSE Trading • United States

Hybrid
USD 165,000 - 225,000
Senior DevOps, Platform Engineer
Senior DevOps, Platform Engineer

Moon • Glendale (CA)

Remote
USD 150,000 - 180,000
Senior Accounting Manager
Senior Accounting Manager

moonlite • Chicago (IL)

Hybrid
USD 150,000 - 170,000
Equity compensation
Health benefits
Hybrid work schedule
Software Engineer, Infrastructure
Software Engineer, Infrastructure

Fudo Partners • New York (NY)

On-site
USD 180,000 - 240,000
Medical, dental and vision coverage
Flexible paid time off
Winter break
+3
AI Platform Support Engineer: Kubernetes, GPUs & ML Infra
AI Platform Support Engineer: Kubernetes, GPUs & ML Infra

Lightning AI • New York (NY)

Hybrid
USD 115,000 - 140,000
Health coverage
Equity (RSUs)
401(k) matching
+3
Senior Infrastructure Software Engineer
Senior Infrastructure Software Engineer

Lightning AI • San Francisco (CA)

Remote
USD 180,000 - 220,000
Health coverage
Equity (RSUs)
401(k) matching
+7
Senior Product Manager, AI Infrastructure
Senior Product Manager, AI Infrastructure

Lightning AI • San Francisco (CA)

Hybrid
USD 200,000 - 250,000
Health coverage
Equity
401k matching
+2
Senior Infrastructure Engineer
Senior Infrastructure Engineer

Moonshot • Denton (TX)

On-site
USD 95,000 - 130,000