Senior HPC Engineer

Netweb Technologies India Ltd.; Faridabad District; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

Netweb Technologies India Ltd. in Faridabad seeks a Senior Engineer-HPC with 8–10 years of Linux administration and 5+ years managing HPC clusters to design, implement, and optimize HPC infrastructure for workloads exceeding 500 cores and multi-petabyte storage.

You will configure Slurm, PBS Pro, or LSF, administer Lustre/BeeGFS/GPFS, and automate with Ansible while collaborating with research teams and DevOps to deliver high-performance solutions.

Qualifications

• 8–10 years of hands-on Linux system administration experience in production environments.
• 5+ years managing HPC clusters at scale (500+ cores / multiple petabytes of storage).
• Strong Ansible automation skills (complex playbooks, roles, variables, templates).
• Deep understanding of MPI, OpenMP, and GPU/accelerator integration in HPC workloads.
• Proficient with HPC job schedulers (Slurm, PBS Pro, LSF).
• Experience with HPC storage (Lustre, BeeGFS, GPFS).
• Strong knowledge of TCP/IP networking, Infiniband, and RDMA technologies.
• Experience with performance tuning and benchmarking tools (perf, hpc tool kit, Intel VTune, Iperf, fio).
• Scripting proficiency in Bash, Python, or Perl for automation and tooling.

Responsibilities

• Design, implement, and maintain HPC environments including compute, storage, and network components.
• Configure and optimize workload managers for efficient job scheduling and resource allocation.
• Tune CPU, GPU, memory, I/O, and network subsystems for workloads.
• Manage HPC filesystem solutions (Lustre, BeeGFS, GPFS).
• Administer enterprise Linux distributions (RHEL, CentOS, Rocky, Ubuntu) at scale.
• Manage kernel upgrades, patching, and security hardening.
• Develop Ansible playbooks for automated provisioning and patching.
• Integrate Ansible with CI/CD pipelines for IaC.
• Automate cluster deployment and ensure environment consistency.
• Implement monitoring with Grafana/Prometheus/Nagios; troubleshoot HPC workloads.
• Provide Tier-3 support for Linux/HPC incidents.
• Document architecture, SOPs, and tuning methodologies.

Skills

Ansible automation

MPI/OpenMP

Linux system administration

HPC workload optimization

Networking: TCP/IP/InfiniBand

Scripting: Bash/Python/Perl

Tools

Slurm

PBS Pro

LSF

Lustre

BeeGFS

GPFS/Spectrum Scale

Infiniband

RDMA

Intel VTune

Iperf

Perf

Job description

Job Title: Senior Engineer-HPC
Department: Production & Support
Location: Faridabad

Position Summary:

Accomplished HPC Systems Engineer with 8–10 years of enterprise Linux administration and over 5 years of hands‑on experience managing large-scale HPC clusters exceeding 500 cores and multi-petabyte storage environments. Proven expertise in designing, implementing, and optimizing HPC infrastructure, including compute, storage, and high-speed networking, to deliver maximum performance for demanding workloads.

Key Responsibilities

HPC Cluster Management & Optimization

• Design, implement, and maintain HPC environments, including compute, storage, and network components.
  
• Configure and optimize Slurm, PBS Pro, or other workload managers/schedulers for efficient job scheduling and resource allocation.
  
• Implement performance tuning for CPU, GPU, memory, I/O, and network subsystems to meet workload demands.
  
• Manage HPC filesystem solutions such as Lustre, BeeGFS, or GPFS/Spectrum Scale.
  

Linux Administration

• Administer enterprise-grade Linux distributions (RHEL, CentOS, Rocky, Ubuntu) in large-scale compute environments.
  
• Manage kernel upgrades, patching, and security hardening.
  
• Troubleshoot kernel-level and system-level issues for performance and stability.
  

Automation & Configuration Management

• Develop and maintain Ansible playbooks/roles for automated provisioning, configuration, and patching of HPC systems.
  
• Integrate Ansible with CI/CD pipelines for infrastructure as code (IaC) practices.
  
• Automate cluster deployment and environment consistency across hundreds of nodes.
  

Monitoring, Troubleshooting & Support

• Implement and maintain monitoring tools (e.g., Grafana, Prometheus, Nagios, Ganglia).
  
• Troubleshoot complex HPC workloads, MPI communication issues, and application performance bottlenecks.
  
• Provide Tier-3 escalation support for Linux/HPC-related incidents.
  

Collaboration & Documentation

• Work closely with research teams, DevOps engineers, and system architects to deliver high-performance solutions.
  
• Document architecture, SOPs, troubleshooting guides, and performance tuning methodologies.

Requirements

Required Skills & Experience

• 8–10 years of hands‑on Linux system administration experience in production environments.
  
• 5+ years managing HPC clusters at scale (500+ cores / multiple petabytes of storage).
  
• Strong Ansible automation skills (complex playbooks, roles, variables, templates).
  
• Deep understanding of MPI, OpenMP, and GPU/accelerator integration in HPC workloads.
  
• Proficient with HPC job schedulers (Slurm, PBS Pro, LSF).
  
• Experience with HPC storage (Lustre, BeeGFS, GPFS).
  
• Strong knowledge of TCP/IP networking, Infiniband, and RDMA technologies.
  
• Experience with performance tuning and benchmarking tools (perf, hpc tool kit, Intel VTune, Iperf, fio).
  
• Scripting proficiency in Bash, Python, or Perl for automation and tooling.

Preferred Qualifications

• Experience with containerized HPC (Singularity, Apptainer, or Podman).
  
• Familiarity with cloud-HPC integration (AWS Parallel Cluster, Azure Cycle Cloud, GCP HPC).
  
• Knowledge of security compliance standards (CIS benchmarks, STIG).
  
• Contribution to HPC community tools or open-source projects.

Soft Skills

• Strong problem-solving and analytical thinking.
  
• Ability to mentor junior engineers and collaborate across teams.
  
• Excellent communication skills for technical and non-technical stakeholders.