Infra Network Operation Manager

GMI Cloud, Inc; United States; On-site; USD 120,000 - 180,000; Full time

Job summary

GMI Cloud, Inc. seeks an experienced Network Operation Manager to architect, deploy, and operate GPU-accelerated network infrastructure across global data centers.

You will design WAN/Core/Data Center networks, manage security, and ensure 99.9%+ availability while supporting AI/ML workloads. Ideal candidates bring 5+ years in senior network roles, strong optical/GPU networking knowledge, and hands-on experience with Infiniband, RoCEv2, and data center fabrics.

Qualifications

• 5+ years of experience as senior network engineer or related position.
• Extensive experience in network deployment and operational support.
• Strong knowledge in network administration and architecture.
• Strong knowledge in network security, DDOS, IDS, etc.
• Familiar with optical networking, including fibers, transceivers and optics.
• Experience with high-performance data center networks, HPC or AI environments.
• Candidates with network certifications (e.g. CCNA, CCNP) preferred.

Responsibilities

• Plan, design, and implement network infrastructure for GMI global data center, including WAN, Core Network, Data Center Network, Firewalls, Load Balancers, DNS, VPN, etc.
• Build high-performance network solutions to support AI/ML workloads, encompassing Compute, Storage, Inband, Management, and Out-of-Band (OOB) network fabric using Infiniband and Ethernet RDMA RoCEv2 technologies.
• Operate, monitor and troubleshoot GPU/HPC network systems (Infiniband, RoCe, Ethernet) to ensure optimal performance on a daily basis.
• Manage and configure optical transceivers and related components
• Collaborate with cross-functional teams and stakeholders to understand business requirements related to networking
• Identify suitable network providers, vendors, and solutions to meet organizational needs
• Ensure high performance, scalability, and 99.9%+ availability of network services
• Implement network security measures and perform system upgrades
• Document network configurations, issues, and resolution procedures
• Conduct root cause analysis and resolve network outages efficiently
• Keep abreast of advancements in optical communications, GPU networking, and data center technologies
• Regional/international travel to GMI data center locations.

Skills

Network design

GPU networking

Infiniband

RoCEv2

Network monitoring

Network security

Troubleshooting

CCNA/CCNP

Education

Bachelor’s degree in Computer Science

Tools

Routers

Switches

Firewalls

Load balancers

DNS

VPN

Job description

GMI Cloud is a fast-growing, AI-native infrastructure company delivering high-performance GPU compute, inference services, and infrastructure for AI agents.

Following 8x ARR growth, GMI Cloud continues to scale rapidly across the U.S. and APAC. As a Reference Platform NVIDIA Cloud Partner (NCP) and a validated leading NCP across both markets, we power production AI for leading AI-native companies including Fireworks AI, Cartesia, Reflection, and OpenRouter.

From large-scale compute to optimized inference and agentic workloads, GMI Cloud gives AI teams the infrastructure they need to build, deploy, and scale on one unified cloud.

One cloud for compute, inference, and agents.

Role Overview

We are seeking a skilled Network Operation Manager to join the GMI Global Infrastructure team. The ideal candidate will have hands-on experience with GPU network infrastructure and strong understanding of optical communication technologies. You will be responsible for designing, building, maintaining, monitoring, and optimizing advanced network systems to ensure high performance and reliability, supporting our global data centers and AI/ML workloads.

Preferred Location: Denver, Taipei.

Responsibilities

• Plan, design, and implement network infrastructure for GMI global data center, including WAN, Core Network, Data Center Network, Firewalls, Load Balancers, DNS, VPN, etc.
• Build high-performance network solutions to support AI/ML workloads, encompassing Compute, Storage, Inband, Management, and Out-of-Band (OOB) network fabric using Infiniband and Ethernet RDMA RoCEv2 technologies.
• Operate, monitor and troubleshoot GPU/HPC network systems (Infiniband, RoCe, Ethernet) to ensure optimal performance on a daily basis.
• Manage and configure optical transceivers and related components
• Collaborate with cross-functional teams and stakeholders to understand business requirements related to networking
• Identify suitable network providers, vendors, and solutions to meet organizational needs
• Ensure high performance, scalability, and 99.9%+ availability of network services
• Implement network security measures and perform system upgrades
• Document network configurations, issues, and resolution procedures
• Conduct root cause analysis and resolve network outages efficiently
• Keep abreast of advancements in optical communications, GPU networking, and data center technologies
• Regional/international travel to GMI data center locations.

Qualifications

• Bachelor’s degree in Computer Science or related field.
• Over 5 years of experience as senior network engineer or related position.
• Extensive experience in network deployment and operational support.
• Strong knowledge in network administration and architecture.
• Strong knowledge in network security, DDOS, IDS, etc.
• Familiar with various routers, switches, firewalls, load balancer, DNS, VPN configuration implementation.
• Familiar with network monitoring tools and protocols.
• Familiar with optical networking, including fibers, transceivers and optics.
• Experience with high-performance data center networks, HPC or AI environments.
• Excellent problem-solving, troubleshooting and communication skills.
• Candidates holding network certifications (e.g. CCNA, CCNP) will be strongly preferred.
• Candidates with proven experience in the AI/ML GPU networking environment will be highly considered.

Meeting every qualification is not required—if you’re excited about this role, we’d love to hear from you. We believe diverse perspectives and experiences strengthen our team.