Nvidia Network Engineer (InfiniBand / Ethernet)

Larsen & Toubro Limited

Chennai

On-site

INR 4,200,000 - 6,800,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Larsen & Toubro (L&T) in India seeks a senior engineer to deliver and operate ultralow-latency network fabrics for GPU training at scale. You will design east–west InfiniBand and north–south Ethernet connectivity, and optimize leaf-spine topologies with ECMP to ensure deterministic performance.

The role emphasizes reliability, incident management, and automation. You will tune RoCE v2, implement QoS, monitor NCCL performance across pods, and lead P0/P1 response for GPU infrastructure,

Qualifications

  • BE/BTech or equivalent with Computer Science or Electronics & Communication.
  • 715 years DC networking; deep InfiniBand (HDR/NDR) and RoCE tuning at scale.
  • Certifications include NVIDIA Networking; CCNP/CCIE DC; JNCIPDC / Arista ACE.

Responsibilities

  • Implementation: Build IB (HDR/NDR) east–west fabrics and Ethernet north–south connectivity; leaf-spine with ECMP.
  • Deploy and tune RoCE v2, PFC/ECN, MTU, buffer profiles; IB routing/credit/timers; SHARP/UCX offloads where applicable.
  • Operations: Day2 fabric health (congestion hotspots, slowdrain, link flaps); automate config with Ansible/Terraform.
  • Lifecycle of switch OS/firmware; linklevel optics and cable qualification; inventory and spares.
  • Performance & Optimization: Validate NCCL collectives performance across pods; troubleshoot allreduce bottlenecks and imbalance.
  • Implement QoS classes for training vs inference vs controlplane.
  • Reliability & Incident: Lead P0/P1 critical incident response for NVIDIA GPU infrastructure, including InfiniBand, RoCE, Ethernet fabric and AI/ML cluster environments.
  • Security & Compliance: BGP/EVPN multitenancy, ACLs, rolebased access to fabric managers; config signing/change control.

Skills

InfiniBand HDR/NDR tuning
RoCE tuning
GPU cluster communications
NVIDIA UFM/NetQ
Ansible/Terraform
NCCL tests

Education

BE/BTech or equivalent with CS or Electronics & Communication
Certifications: NVIDIA Networking; CCNP/CCIE DC; JNCIPDC / Arista ACE

Tools

NVIDIA UFM/NetQ
Spectrum/Quantum
Cumulus/Onyx/SONiC
iperf
NCCLtests
sFlow/telemetry
Ansible
Terraform

Job description

Job Purpose

Deliver and operate ultralowlatency, highbisection network fabrics for GPU training at ~10K GPU scale with deterministic performance.

Role Description
Key Responsibilities
  • Implementation
    • Build IB (HDR/NDR) eastwest fabrics and Ethernet northsouth connectivity; leafspine with ECMP.
    • Deploy and tune RoCE v2, PFC/ECN, MTU, buffer profiles; IB routing/credit/timers; SHARP/UCX offloads where applicable.
  • Operations
    • Day2 fabric health (congestion hotspots, slowdrain, link flaps); automate config with Ansible/Terraform.
    • Lifecycle of switch OS/firmware; linklevel optics and cable qualification; inventory and spares.
  • Performance & Optimization
    • Validate NCCL collectives performance across pods; troubleshoot allreduce bottlenecks and imbalance.
    • Implement QoS classes for training vs inference vs controlplane.
  • Reliability & Incident
    • Lead P0/P1 critical incident response for NVIDIA GPU infrastructure, including InfiniBand, RoCE, Ethernet fabric and AI/ML cluster environments.
    • Troubleshot performance bottlenecks involving InfiniBand fabrics, RoCE networks, congestion management, NCCL communications, GPUDirect RDMA, and distributed AI training workloads.
    • Led post-incident reviews and implemented automation, monitoring enhancements, and architectural improvements to increase overall cluster availability, stability, and performance.
    • Create runbooks for path failures, fabric partitions, and credit starvation; design graceful degradation.
  • Security & Compliance
    • BGP/EVPN multitenancy, ACLs, rolebased access to fabric managers; config signing/change control.
Experience & Educational Requirements
Qualifications and Experience
EDUCATIONAL QUALIFICATIONS:

(degree, training, or certification required)

BE/B-Tech or equivalent with Computer Science or Electronics & Communication

RELEVANT EXPERIENCE:

(no. of years of technical, functional, and/or leadership experience or specific exposure required)

  • 715 years DC networking; deep InfiniBand (HDR/NDR) and RoCE tuning at scale; GPU cluster comms patterns.
Tools / Tech

NVIDIA UFM/NetQ (or equivalent), Spectrum/Quantum families, Cumulus/Onyx/SONiC; iperf/NCCLtests; sFlow/telemetry; Ansible/Terraform.

Certifications

NVIDIA Networking; CCNP/CCIE DC; JNCIPDC / Arista ACE.

KPIs

Fabric throughput/latency SLOs, congestion events, NCCL job throughput variance, change success rate.

Work Mode

Onsite for build/turnups; oncall for P1 network incidents.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Network Engineer (L3)
Senior Network Engineer (L3)

RackBank Datacenters • Raipur

On-site
INR 350,000 - 550,000
HPC Engineer (Network)
HPC Engineer (Network)

World Wide Technology, Inc. • Mumbai

On-site
INR 3,000,000 - 6,000,000
Senior Solutions Architect, Infiniband and Networking Ethernet - NVIS
Senior Solutions Architect, Infiniband and Networking Ethernet - NVIS

Mployee.me • Pune District

On-site
INR 4,200,000 - 7,000,000
Nvidia GPU Infrastructure Engineer / HPC Engineer
Nvidia GPU Infrastructure Engineer / HPC Engineer

Larsen & Toubro Limited • Chennai

Hybrid
INR 900,000 - 1,300,000
HPC Engineer (Network)
HPC Engineer (Network)

World Wide Technology, Inc. • India

Remote
INR 1,800,000 - 3,600,000
Industrial AI Cloud - Network Engineer
Industrial AI Cloud - Network Engineer

Deutsche Telekom AG • India

Hybrid
INR 900,000 - 1,400,000
Hybrid working model
Senior Solutions Architect, Networking and Compute Infrastructure
Senior Solutions Architect, Networking and Compute Infrastructure

NVIDIA Corporation • Gurugram District

On-site
INR 4,000,000 - 6,500,000
Senior Network Infrastructure Engineer
Senior Network Infrastructure Engineer

NVIDIA Corporation • Pune District

Remote
INR 1,500,000 - 2,100,000
Senior Solutions Architect, Networking and Compute Infrastructure
Senior Solutions Architect, Networking and Compute Infrastructure

NVIDIA Corporation • Gurugram District

On-site
INR 3,500,000 - 7,500,000
Network Performance Engineer – GPU/HPC Infrastructure
Network Performance Engineer – GPU/HPC Infrastructure

Ishan Technologies • Ahmedabad District

On-site
INR 2,400,000 - 5,400,000