Staff Network Engineer — GPU Data Center & HPC Networking

Matcha; Northern (KY); Hybrid; USD 150,000 - 300,000; Full time

Job summary

Prime Intellect is seeking a Senior Network Engineer to design and operate the networks that connect large GPU clusters. You will own the reliability and performance of training fabrics, storage networks, and management connectivity to ensure distributed workloads scale without bottlenecks.

You will build scalable datacenter topologies, configure Ethernet/RoCE and InfiniBand fabrics, automate provisioning, diagnose performance issues, and partner with operators and vendors to resolve failures.

Qualifications

• 3+ years of production datacenter networking experience.
• Strong understanding of Ethernet, TCP/IP, routing, switching, and redundant network design.
• Hands-on experience with high-performance GPU networking using InfiniBand or RoCE.
• Experience troubleshooting network problems across Linux hosts, NICs, switches, and physical links.
• Ability to automate network operations with Python, Ansible, or comparable tools.

Responsibilities

• Design and deploy scalable datacenter network topologies for GPU training, inference, storage, and management traffic.
• Configure and operate high-performance Ethernet/RoCE and InfiniBand fabrics with standards for routing, redundancy, and capacity.
• Automate network provisioning, configuration validation, upgrades, and rollback procedures.
• Diagnose packet loss, congestion, link failures, and performance across hosts and switches.
• Benchmark end-to-end network performance with infra and ML teams; translate workload needs into acceptance criteria.
• Build monitoring for port health, errors, utilization, congestion, and topology; improve incident response.
• Partner with datacenter operators and hardware vendors on cabling, optics, deployment readiness, and failure resolution.

Skills

Datacenter networking

Ethernet/TCP/IP

RoCE/InfiniBand

Linux networking

Automation (Python/Ansible)

Tools

Python

Ansible

NIC drivers

RoCE/InfiniBand tooling

Job description

Prime Intellect is seeking a Senior Network Engineer to design and operate the networks that connect large GPU clusters. You will own the reliability and performance of training fabrics, storage networks, and management connectivity to ensure distributed workloads scale without bottlenecks.

You will build scalable datacenter topologies, configure Ethernet/RoCE and InfiniBand fabrics, automate provisioning, diagnose performance issues, and partner with operators and vendors to resolve failures.