Senior AI Infrastructure Network Engineer (HPC)

Nscale; San Francisco (CA); On-site; USD 150,000 - 240,000; Full time

Benefits offered by this job

Base + equity

Medical, dental, vision

Flexible PTO

Job summary

Nscale is seeking a Senior Network Engineer – AI Infrastructure to own the health and performance of our Infiniband/RoCE fabrics powering AI workloads. You will lead incident response, drive performance tuning, and collaborate with SREs to build automation. We offer base + equity and a competitive package in a hyperscale environment.

Join a 24/7 operational team focused on reliability, latency, and scalable AI networking, with opportunities to influence fabric design and tooling decisions.

Qualifications

• 5+ years of experience in network engineering, with at least 3 years operating HPC or large-scale AI interconnect networks.
• Deep, hands-on operational experience with Infiniband and/or modern RoCE deployments.
• Proficiency in Linux-based tooling and fabric diagnostics.

Responsibilities

• Owning the operational health, configuration consistency, and performance tuning of large-scale Infiniband and RoCE fabrics supporting AI and HPC workloads.
• Leading diagnosis and resolution of complex network incidents (P0/P1) across firmware, kernel drivers, switch hardware, and applications.
• Driving blameless postmortems and implementing preventative fixes to improve fabric stability and availability.
• Partnering with SREs to define automation requirements and contribute to network provisioning, validation, and monitoring systems.
• Collaborating with Network Architecture and Engineering teams to validate fabric designs and enforce routing, congestion control, and firmware baselines.
• Monitoring fabric utilisation and performance, identifying bottlenecks, and tuning for congestion and latency.
• Acting as SME for cross-functional teams on high-speed networking and fabric-level performance characteristics.
• Participating in on-call rotation supporting mission-critical infrastructure.

Skills

Network engineering

RDMA concepts

Linux tooling

Python/Go scripting

High performance networking

Tools

NVIDIA Spectrum switches

ConnectX NICs

Prometheus

Grafana

Job description

Nscale is seeking a Senior Network Engineer – AI Infrastructure to own the health and performance of our Infiniband/RoCE fabrics powering AI workloads. You will lead incident response, drive performance tuning, and collaborate with SREs to build automation. We offer base + equity and a competitive package in a hyperscale environment.

Join a 24/7 operational team focused on reliability, latency, and scalable AI networking, with opportunities to influence fabric design and tooling decisions.