Senior Network Engineer

Nscale; Houston (TX); On-site; USD 150,000 - 210,000; Full time

Benefits offered by this job

Competitive benefits package

Flexible paid time off

Parental leave

Retirement plan participation

Job summary

Nscale, a GPU cloud engineered for AI, is seeking a Senior Network Engineer to design and operate scalable InfiniBand and Ethernet fabrics for AI/ML workloads. You will own end-to-end network areas, mentor peers, and drive automation in a fast-paced cloud environment.

Join a team focused on high-performance, low-latency networking, cross-functional collaboration, and building scalable infrastructure for training and inference at scale.

Qualifications

• 8+ years of network engineering experience in HPC, AI, or hyperscale data centres.
• Deep RDMA/networking experience (InfiniBand, RoCE) for AI/HPC workloads.
• Strong design and operation of modern DC routing and control planes (BGP, EVPN-VxLAN).

Responsibilities

• Design, validate, and operate large-scale InfiniBand/RoCE and Ethernet fabric architectures.
• Develop and maintain network automation in a GitOps model using Python/Ansible.
• Drive incident response, root-cause analysis, and improve observability with telemetry and dashboards.
• Collaborate with deployment, DC operations, platform engineering, and vendors.
• Mentor engineers and contribute to site delivery across multiple locations.

Skills

Network engineering

RDMA networking

BGP EVPN VxLAN

Python

Ansible

Git

Firewall design

HPC/AI workloads

Network observability

Tools

Cumulus

Nokia

Arista EOS

OpenSM

UFM

Terraform

GitLab CI/GitHub Actions

Job description

About Nscale

Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale enables AI-focused companies to achieve superior results by reducing the complexity of AI development. Our GPU cloud bolsters technical capabilities and directly supports strategic business outcomes, including cost management, rapid innovation, and environmental responsibility.

About Nscale

Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale enables AI-focused companies to achieve superior results by reducing the complexity of AI development. Our GPU cloud bolsters technical capabilities and directly supports strategic business outcomes, including cost management, rapid innovation, and environmental responsibility.

At Nscale, our Engineering team plays a critical role in driving the deployment and then subsequent management of our infrastructure and software platforms.

We thrive on a culture of relentless innovation, ownership, and accountability, where every team member takes pride in their work and drives it with excellence and urgency. As an Nscaler, you'll build trust through openness and transparency, where everyone is inspired to do their best work. If you join our team, you'll be contributing to building the technology that powers the future.

About The Role

The Network Engineering Team is responsible for the design, validation, and ongoing operation of all networking services that underpin both the internal management platform and the customer-facing cloud infrastructure — including high-performance Ethernet fabrics, InfiniBand, WAN connectivity, and DC networking. The team acts as a 3rd/4th line escalation point for the support organisation.

As a Senior Network Engineer, you will own the design, automation, and in-service operation of our AI-optimised network fabrics — low-latency, high-bandwidth InfiniBand and Ethernet networks supporting large-scale training and inference workloads. You'll take ownership of technical areas end to end, act as a senior escalation point, and help raise the bar on how the team automates, documents, and operates the network.

What You'll Be Doing

• Design, validate, and operate large-scale InfiniBand/RoCE and Ethernet fabric architectures at rack, row, and DC scale, with tight integration to bare-metal provisioning and cluster management systems.
• Apply deep expertise in high-performance Ethernet fabrics (BGP, EVPN, VxLAN, LACP, QoS) and contribute to reference architectures and standards implemented consistently across sites.
• Design and engineer perimeter and security infrastructure — firewalls, NAT, VPN, and security policy architecture — across WAN and DC edge environments.
• Build and maintain network automation in a GitOps model: Python/Ansible tooling for provisioning, configuration validation, and compliance, with version-controlled configuration and CI/CD-driven change across multi-vendor environments.
• Drive operational excellence: resolve complex escalations, lead root-cause analysis for performance and stability issues, and reduce reactive toil through runbooks, automation, and measurable SLOs.
• Improve network observability — telemetry, monitoring, and alerting that give clear visibility into fabric health and traffic patterns.
• Maintain the accuracy of source-of-truth network inventory and configuration data, with all changes flowing through structured change management.
• Collaborate with deployment, DC operations, platform engineering, and vendors on new site delivery, and mentor engineers across the team through reviews and knowledge sharing.
  

About You (Skills / Qualifications)

• 8+ years of network engineering experience, with depth in HPC, AI, or hyperscale data centre environments.
• Extensive hands-on experience with RDMA-aware networking (InfiniBand, RoCE) for AI/HPC workloads, including subnet managers (OpenSM, UFM) and fabric orchestration.
• Expert-level knowledge of modern DC routing and control planes (BGP, EVPN-VxLAN, Clos/spine-leaf), with production experience on platforms such as Cumulus, Nokia, or Arista EOS.Strong automation skills: Python and Ansible, Git-based workflows, and familiarity with modern IaC and pipeline tooling (Terraform, GitLab CI/GitHub Actions); you treat the network as code rather than managing devices by hand.
• Strong design and engineering experience with firewall platforms — Juniper SRX and/or Palo Alto — including security policy architecture, HA design, and multi-tenant segmentation.
• Experience designing network telemetry and observability for high-throughput environments.
• Proven ability to work cross-functionally with systems, storage, and HPC/AI workload teams, and comfortable leading incident response at senior escalation levels.
• Hands-on, adaptable, and comfortable in a fast-paced environment building next-generation infrastructure for ML scale-out.
  

Equal Opportunities Statement

At Nscale, we are committed to fostering an inclusive, diverse, and equitable workplace. We believe that a variety of perspectives enriches our work environment, and we encourage applications from candidates of all backgrounds, experiences, and abilities. We strongly encourage applications from people of colour, the LGBTQ+ community, people with disabilities, neurodivergent people, parents, carers, and people from lower socio-economic backgrounds.

If there's anything we can do to accommodate your specific situation, please let us know.

The range below reflects the base salary for the position. Actual compensation may vary based on job-related factors such as skill set, experience, education, and location. In addition to base salary, this role may be eligible for bonus, equity, and/or commission programs. Nscale may offer a competitive benefits package including medical, dental, vision, flexible paid time off, parental leave, and retirement plan participation.

Salary Range: $150,000 USD - $210,000 USD

For information on how Nscale handles candidate personal data, please see our Employee & Candidate Privacy Notice: Here.