GPU Infrastructure Engineer / HPC Engineer

L&T Technology Services Ltd.

Mumbai

On-site

INR 4,000,000 - 8,500,000

Full time

7 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

L&T Technology Services Ltd. in Mumbai is seeking an experienced GPU Infrastructure Engineer to build and operate large-scale GPU compute pods for high-throughput AI training and inference across a multi-rack 10K GPU cluster.

Expect deep work with GPGPU, CUDA, MIG/vGPU, Slurm and Kubernetes device scheduling to deliver predictable, low-latency performance. You will lead capacity planning, performance tuning, and incident management, coordinate with Networking, GPU Ops, Platform Eng, and Storage

Qualifications

  • BE/BTech or equivalent in Computer Science or Electronics & Communications.
  • 6–10 years of HPC/AI GPU cluster experience.
  • Experience with CUDA, MIG/vGPU, and GPU scheduling tools (Slurm/Kubernetes).

Responsibilities

  • Stand up large-scale GPU clusters (rack/power/cooling, IB/Ethernet) for training and inference.
  • Integrate cluster schedulers (Slurm/Kubernetes) with GPU device plugins and accounting.
  • Own day-to-day operations across firmware, drivers, and tooling lifecycles; minimize downtime.
  • Perform capacity planning and optimization for heterogeneous GPU SKUs.
  • Tune performance (NCCL/UCX, CUDA runtimes) and drive benchmarking suites.
  • Lead incident response for GPU/CUDA/scheduler issues and perform RCAs.

Skills

GPGPU
CUDA
HPC

Education

BE/BTech in CS/EE

Tools

Slurm
Kubernetes
NCCL/UCX

Job description

GPU Infrastructure Engineer / HPC Engine...

LNT/GIE-HE/1920234

  • IU72-Larsen & Toubro – Vyoma
  • AMN Tower, Powai

End Date 09 May 2027

Required Experience 6 - 10 years

Skills
Knowledge & Posting Location

GPGPU CUDA Artificial Intelligence HPC

Bachelor of Technology (BTech)

Job Description

Build and operate large?scale GPU compute pods to deliver predictable, high?throughput, low?latency training and inference services across 10K GPU cluster.

  • Implementation

Stand up multi?pod GPU clusters (rack/power/cooling layouts; TOR/leaf connectivity; IB/Ethernet host configs).

Implement GPU partitioning (MIG/vGPU profiles) and quota policies for multi?tenant environments.

Integrate cluster schedulers (Slurm/Kubernetes) with GPU device plugins, node feature discovery, and accounting/quotas.

  • Operations

Own day?2 operations across firmware/driver/DCGM/NVML lifecycles; execute change windows with zero/low downtime.

Capacity planning (GPU/CPU/Memory/NIC) and bin?packing strategies for heterogeneous GPU SKUs.

  • Performance & Optimization

Tune NCCL/UCX, GPU clocks/persistence, GPU Direct Storage, NUMA/locality, and CUDA runtime parameters.

Drive benchmarking and acceptance (HPL, HPL?AI, MLPerf?like internal suites); track perf regressions with SLOs.

  • Reliability & Incident

Lead P0/P1 incident response for GPU, CUDA, or scheduler issues; perform root?cause and preventative actions.

Act as the primary technical lead during production outages, coordinating cross-functional teams across Networking, GPU Operations, Platform Engineering, Storage, and Application teams to restore services within SLA targets.

Perform detailed Root Cause Analysis (RCA) for network, GPU, CUDA, NCCL, RDMA, and scheduler-related failures, identifying underlying causes and implementing preventive and corrective actions.

Collaborate with platform and GPU engineering teams to resolve issues impacting CUDA jobs, Kubernetes scheduling, Slurm workload management, GPU resource allocation, and large-scale AI training environments.

Define golden images; implement node remediation (cordon/drain/reimage) and auto?healing workflows.

  • Security & Compliance

Enforce GPU tenancy isolation (MIG, cgroup/device cgroup, mpsd), secure drivers/containers, SBOM and image scanning.

  • Documentation & Enablement

Publish runbooks, performance baselines, and application tuning guides for LLM training and inference.

Experience & Educational Requirement

BE/B-Tech or equivalent with Computer Science or Electronics & Communication

RELEVANT EXPERIENCE

  • 7–12 years building/operating HPC/AI GPU clusters at scale; deep CUDA/MIG/vGPU expertise.
  • Proven with H100/B?series class GPUs, Slurm and/or Kubernetes device scheduling; NCCL/UCX performance tuning.

Tools / Tech

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Nvidia GPU Infrastructure Engineer / HPC Engineer
Nvidia GPU Infrastructure Engineer / HPC Engineer

Larsen & Toubro Limited • Chennai

Hybrid
INR 900,000 - 1,300,000
GPU Cluster Reliability Engineer
GPU Cluster Reliability Engineer

Ishan Technologies • Ahmedabad District

On-site
INR 1,200,000 - 1,800,000
HPC–AI Infrastructure & GPU Cluster Support Engineer
HPC–AI Infrastructure & GPU Cluster Support Engineer

Aptly Technology Corp. • Bengaluru

Hybrid
INR 1,200,000 - 1,800,000
Senior Engineer Specialist – GPU Cluster & AI Infrastructure
Senior Engineer Specialist – GPU Cluster & AI Infrastructure

Vivantify Technology Solutions India Private Limited • Chennai

On-site
INR 1,400,000 - 2,800,000
Competitive salary
Growth opportunities
Collaborative environment
+1
Technology Platform Engineer
Technology Platform Engineer

Accenture PLC • Gurugram District

On-site
INR 1,800,000 - 2,600,000
Technology Platform Engineer
Technology Platform Engineer

Accenture PLC • Bengaluru

On-site
INR 2,500,000 - 4,500,000
Senior Engineer Specialist – GPU Cluster & AI Infrastructure
Senior Engineer Specialist – GPU Cluster & AI Infrastructure

Vivantify Technology Solutions India Pvt. Ltd. • Chennai

On-site
INR 2,000,000 - 3,000,000
Competitive salary
Professional growth
Collaborative environment
+1
HPC Engineer (Compute)
HPC Engineer (Compute)

World Wide Technology, Inc. • Mumbai

On-site
INR 1,500,000 - 4,000,000
Systems Integration Senior Specialist
Systems Integration Senior Specialist

TekWissen • Hyderabad, Bengaluru

Hybrid
INR 1,800,000 - 2,400,000
HPC Engineer (Compute)
HPC Engineer (Compute)

World Wide Technology, Inc. • India

Remote
INR 900,000 - 1,500,000