Infra Engineer - Network Operation

GMI Cloud, Inc; United States; On-site; USD 140,000 - 180,000; Full time

Job summary

GMI Cloud, Inc. seeks a skilled Network Operation Engineer to join the GMI Global Infrastructure team.

You will design, build, monitor, and optimize GPU-enabled network systems to support AI/ML workloads across global data centers. The ideal candidate has hands-on experience with GPU networking, optical communications, Infiniband, and RDMA RoCEv2, and will collaborate with cross-functional teams to ensure high performance, reliability, and 99.9%+ availability.

Qualifications

• Bachelor’s degree in Compute Science or related field.
• 5+ years of experience as senior network engineer or related position.
• Extensive experience in network deployment and operational support.
• Strong knowledge in network administration and architecture.
• Strong knowledge in network security, DDOS, IDS, etc.
• Familiar with various routers, switches, firewalls, load balancer, DNS, VPN configuration implementation.
• Familiar with network monitoring tools and protocols.
• Familiar with optical networking, including fibers, transceivers and optics.
• Experience with high-performance data center networks, HPC or AI environments.
• Excellent problem-solving, troubleshooting and communication skills.
• Candidates holding network certifications (e.g. CCNA, CCNP) will be strongly preferred.
• Candidates with proven experience in the AI/ML GPU networking environment will be highly considered.

Responsibilities

• Plan, design, and implement network infrastructure for GMI global data center, including WAN, Core Network, Data Center Network, Firewalls, Load Balancers, DNS, VPN, etc.
• Build high-performance network solutions to support AI/ML workloads, involving Compute, Storage, Inband, Management, and Out-of-Band (OOB) network fabric using Infiniband and Ethernet RDMA RoCEv2 technologies.
• Monitor and troubleshoot GPU-based network systems to ensure optimal performance
• Manage and configure optical transceivers and related components
• Collaborate with cross-functional teams and stakeholders to understand business requirements related to networking
• Identify suitable network providers, vendors, and solutions to meet organizational needs
• Ensure high performance, scalability, and 99.9%+ availability of network services
• Implement network security measures and perform system upgrades
• Document network configurations, issues, and resolution procedures
• Conduct root cause analysis and resolve network outages efficiently
• Keep abreast of advancements in optical communications, GPU networking, and data center technologies
• Regional/international travel to GMI data center locations.

Skills

GPU networking

Network deployment

Troubleshooting

Network security

DDOS

IDS

Router configuration

Switch configuration

Infiniband

RDMA RoCEv2

Optical networking

Education

Bachelor’s degree in Compute Science or related field

Tools

Firewalls

Load balancers

DNS

VPN

Monitoring tools

Job description

We are seeking a skilled Network Operation Engineer to join the GMI Global Infrastructure team. The ideal candidate will have hands-on experience with GPU network infrastructure and strong understanding of optical communication technologies. You will be responsible for designing, building, maintaining, monitoring, and optimizing advanced network systems to ensure high performance and reliability, supporting our global data centers and AI/ML workloads.

Responsibilities

• Plan, design, and implement network infrastructure for GMI global data center, including WAN, Core Network, Data Center Network, Firewalls, Load Balancers, DNS, VPN, etc.
• Build high-performance network solutions to support AI/ML workloads, encompassing Compute, Storage, Inband, Management, and Out-of-Band (OOB) network fabric using Infiniband and Ethernet RDMA RoCEv2 technologies.
• Monitor and troubleshoot GPU-based network systems to ensure optimal performance
• Manage and configure optical transceivers and related components
• Collaborate with cross-functional teams and stakeholders to understand business requirements related to networking
• Identify suitable network providers, vendors, and solutions to meet organizational needs
• Ensure high performance, scalability, and 99.9%+ availability of network services
• Implement network security measures and perform system upgrades
• Document network configurations, issues, and resolution procedures
• Conduct root cause analysis and resolve network outages efficiently
• Keep abreast of advancements in optical communications, GPU networking, and data center technologies
• Regional/international travel to GMI data center locations.

Qualifications

• Bachelor’s degree in Compute Science or related field.
• Over 5 years of experience as senior network engineer or related position.
• Extensive experience in network deployment and operational support.
• Strong knowledge in network administration and architecture.
• Strong knowledge in network security, DDOS, IDS, etc.
• Familiar with various routers, switches, firewalls, load balancer, DNS, VPN configuration implementation.
• Familiar with network monitoring tools and protocols.
• Familiar with optical networking, including fibers, transceivers and optics.
• Experience with high-performance data center networks, HPC or AI environments.
• Excellent problem-solving, troubleshooting and communication skills.
• Candidates holding network certifications (e.g. CCNA, CCNP) will be strongly preferred.
• Candidates with proven experience in the AI/ML GPU networking environment will be highly considered.

Meeting every qualification is not required—if you’re excited about this role, we’d love to hear from you. We believe diverse perspectives and experiences strengthen our team.