Senior GPU Network Operations Engineer (AI Data Centers)

GMI Cloud, Inc; United States; On-site; USD 120,000 - 180,000; Full time

Job summary

GMI Cloud, Inc is seeking a skilled Network Operation Engineer to join the Global Infrastructure team. You will design, build, monitor, and optimize advanced network systems for AI workloads across data centers, with focus on GPU networking and optical communications.

Preferred Location: Denver, Taipei. Responsibilities include implementing WAN/Data Center networks, security, and high availability, with travel to data centers as needed.

Qualifications

• Bachelor’s degree in Computer Science or related field.
• 5+ years of experience as senior network engineer or related position.
• Extensive experience in network deployment and operational support.
• Strong knowledge in network administration and architecture.
• Strong knowledge in network security, DDOS, IDS, etc.
• Familiar with various routers, switches, firewalls, load balancer, DNS, VPN configuration implementation.
• Familiar with network monitoring tools and protocols.
• Familiar with optical networking, including fibers, transceivers and optics.
• Experience with high-performance data center networks, HPC or AI environments.
• Excellent problem-solving, troubleshooting and communication skills.
• Candidates holding network certifications (e.g. CCNA, CCNP) will be strongly preferred.
• Candidates with proven experience in the AI/ML GPU networking environment will be highly considered.

Responsibilities

• Plan, design, and implement network infrastructure for GMI global data center, including WAN, Core Network, Data Center Network, Firewalls, Load Balancers, DNS, VPN, etc.
• Build high-performance network solutions to support AI/ML workloads, encompassing Compute, Storage, Inband, Management, and Out-of-Band (OOB) network fabric using Infiniband and Ethernet RDMA RoCEv2 technologies.
• Operate, monitor and troubleshoot GPU/HPC network systems (Infiniband, RoCe, Ethernet) to ensure optimal performance on a daily basis.
• Manage and configure optical transceivers and related components
• Collaborate with cross-functional teams and stakeholders to understand business requirements related to networking
• Identify suitable network providers, vendors, and solutions to meet organizational needs
• Ensure high performance, scalability, and 99.9%+ availability of network services
• Implement network security measures and perform system upgrades
• Document network configurations, issues, and resolution procedures
• Conduct root cause analysis and resolve network outages efficiently
• Keep abreast of advancements in optical communications, GPU networking, and data center technologies
• Regional/international travel to GMI data center locations.

Job description

GMI Cloud, Inc is seeking a skilled Network Operation Engineer to join the Global Infrastructure team. You will design, build, monitor, and optimize advanced network systems for AI workloads across data centers, with focus on GPU networking and optical communications.

Preferred Location: Denver, Taipei. Responsibilities include implementing WAN/Data Center networks, security, and high availability, with travel to data centers as needed.