Senior Network Platform Engineer — AI Infrastructure

Moonlite

United States

On-site

USD 180,000 - 260,000

Full time

7 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive salary with equity
On-the-job training and mentorship
Career development opportunities
Health, dental, and vision insurance
401(k) with up to 6% match
Paid time off and holidays

Job summary

Moonlite builds the infrastructure behind ambitious AI. You will design and implement the network orchestration and provisioning systems that manage DPU-accelerated networking, tenant isolation, and lifecycle management for GPU clusters.

Work with network, infra, and product teams to deliver enterprise-grade networking with cloud-like simplicity, focusing on performance, security, and observability for large-scale model training.

Qualifications

  • 5+ years in software engineering with proven experience building network platforms, SDN systems, or network automation for production environments.
  • Deep understanding of networking fundamentals including TCP/IP, VLANs, VXLAN, BGP, OSPF, routing protocols, and data center network architectures.
  • Background in SDN concepts, network virtualization, overlay networks, and programmable networking technologies.
  • Experience with Shell scripting and/or Python.
  • Strong experience with Linux networking stack, including network namespaces, iptables/nftables, Open vSwitch, and kernel networking systems.
  • Understanding of RDMA, RoCE, Infiniband, and low-latency networking requirements for distributed computing and GPU workloads.
  • Demonstrated ability to solve complex networking performance and scalability challenges while balancing pragmatic shipping with good long-term architecture.
  • Comfortable navigating ambiguity, defining requirements collaboratively, and communicating technical decisions through clear documentation.
  • Growth mindset with continuous focus on learning and professional development.

Responsibilities

  • Design and build scalable SDN orchestration systems using Bluefield DPUs to deliver programmable, high-performance networking for AI workloads with hardware-accelerated forwarding isolation.
  • Implement automated SDN provisioning systems that handle VPC creation, subnet allocation, routing configuration, and network resource lifecycle from deployment through decommissioning.
  • Develop platform capabilities for managing Bluefield DPUs including SR-IOV virtual function management, OVS offload configuration, network function deployment, and integration with compute orchestration systems.
  • Build enterprise-grade network isolation using VPCs, VXLAN, and hardware-accelerated forwarding to ensure complete tenant separation while maintaining high-performance connectivity for GPU clusters and distributed workloads.
  • Collaborate with infrastructure to optimize network paths for RDMA, RoCE, and GPU-to-GPU communication, ensuring minimal latency and maximum throughput for distributed training and large-scale computational workloads.
  • Develop robust APIs and SDKs for network resource management that integrate with compute and storage platforms for programmatic provisioning and configuration.
  • Implement comprehensive network monitoring, telemetry, and troubleshooting systems that provide visibility into performance, utilization, and tenant traffic patterns.
  • Build platform network security features including security groups, firewall rules, and policy enforcement.

Skills

SDN concepts
Networking fundamentals
Python
Shell scripting
Linux networking
Open vSwitch

Tools

NVIDIA Bluefield DPUs
DOCA framework
Open vSwitch
Terraform
gRPC
FastAPI

Job description

Moonlite builds the infrastructure behind ambitious AI. You will design and implement the network orchestration and provisioning systems that manage DPU-accelerated networking, tenant isolation, and lifecycle management for GPU clusters.

Work with network, infra, and product teams to deliver enterprise-grade networking with cloud-like simplicity, focusing on performance, security, and observability for large-scale model training.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Infra Platform Engineer
Senior AI Infra Platform Engineer

Moonlite • United States

On-site
USD 165,000 - 225,000
Startup equity
Fully covered health insurance
6% 401(k) match
+1
Senior Compute Platform Engineer - Remote AI Infrastructure
Senior Compute Platform Engineer - Remote AI Infrastructure

NEPSE Trading • United States

Hybrid
USD 165,000 - 225,000
Senior Software Engineer, Network Platform
Senior Software Engineer, Network Platform

Moonlite • United States

On-site
USD 180,000 - 260,000
Competitive salary with equity
On-the-job training and mentorship
Career development opportunities
+3
Senior Compute Platform Engineer: GPU & Bare-Metal
Senior Compute Platform Engineer: GPU & Bare-Metal

Moonlite • United States

Remote
USD 165,000 - 225,000
Startup equity
Industry-leading benefits
Competitive compensation
Senior Software Engineer, Platform Infrastructure
Senior Software Engineer, Platform Infrastructure

Moonlite • United States

On-site
USD 165,000 - 225,000
Startup equity
Fully covered health insurance
6% 401(k) match
+1
Senior Software Engineer, Compute Platform
Senior Software Engineer, Compute Platform

NEPSE Trading • United States

Hybrid
USD 165,000 - 225,000
Senior Software Engineer, Compute Platform
Senior Software Engineer, Compute Platform

Moonlite • United States

Remote
USD 165,000 - 225,000
Startup equity
Industry-leading benefits
Competitive compensation
Remote Senior Kubernetes & Infra Reliability Engineer
Remote Senior Kubernetes & Infra Reliability Engineer

moonlite • United States

Remote
USD 140,000 - 210,000
Staff Networking Platform Engineer – AI Cloud Networking
Staff Networking Platform Engineer – AI Cloud Networking

Themuralgroup • United States

Remote
USD 270,000 - 462,000
Staff Networking Platform Engineer, AI Cloud Infrastructure
Staff Networking Platform Engineer, AI Cloud Infrastructure

Mural Group • San Francisco (CA), New York (NY)

Hybrid
USD 270,000 - 462,000