Senior InfiniBand Network Engineer - UFM & AI Fabric

Lightning-Ai; San Francisco (CA); Remote; USD 170,000 - 210,000; Full time

Benefits offered by this job

Comprehensive Health Coverage

Meaningful Equity

401(k) matching

Unlimited PTO and holidays

Winter Break

Job summary

Lightning AI seeks a Senior Network Engineer to design, deploy, automate, and operate InfiniBand fabrics powering AI GPU clusters on a global, scalable platform. The role supports NVIDIA UFM, NCCL, RoCEv2, and modern data-center tech to ensure deterministic performance and reliability.

The candidate will lead networking architecture, troubleshoot performance bottlenecks, and collaborate with AI platforms and storage teams. Remote or hybrid options available within the U.S.

Qualifications

• 7+ years of experience in large-scale data center networking.
• Experience deploying, operating, and troubleshooting InfiniBand environments.
• Strong understanding of Layer 2/3 networking (BGP, EVPN, VXLAN) and spine-leaf.
• Experience with Python, Ansible, Terraform or similar for automation.

Responsibilities

• Design, deploy, and maintain large-scale NVIDIA InfiniBand fabrics for AI GPU clusters.
• Deploy and administer NVIDIA UFM Enterprise for monitoring and fabric health.
• Configure InfiniBand switches and optimize NCCL, MPI, and GPUDirect RDMA.
• Automate network provisioning using Python, Ansible, and IaC.
• Monitor health with UFM telemetry, Prometheus, and Grafana.

Skills

7+ years data center networking

InfiniBand networking

Network troubleshooting

Documentation & communication

Tools

Python

Ansible

Terraform

Git

REST APIs

Job description

Lightning AI seeks a Senior Network Engineer to design, deploy, automate, and operate InfiniBand fabrics powering AI GPU clusters on a global, scalable platform. The role supports NVIDIA UFM, NCCL, RoCEv2, and modern data-center tech to ensure deterministic performance and reliability.

The candidate will lead networking architecture, troubleshoot performance bottlenecks, and collaborate with AI platforms and storage teams. Remote or hybrid options available within the U.S.