Distinguished HPC Engineer

Data In Science Technologies

United States

Remote

USD 120,000 - 190,000

Full time

9 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Data In Science Technologies is seeking an experienced HPC Systems Engineer to design, deploy, and optimize high-performance computing clusters. You will configure storage, networks, and file systems for scalable workloads and work with Bright Cluster Manager for efficient administration.

Responsibilities include setting up Slurm/LSF/UGE schedulers, deploying containers, and building health monitoring to preempt issues.

Qualifications

  • Proven experience building HPC clusters from hardware to software.
  • Extensive Linux system administration and performance tuning.
  • Expertise with Bright Cluster Manager, Slurm, and Ansible.
  • Strong communication and stakeholder management.

Responsibilities

  • Design and implement high-performance computing clusters to meet performance, scalability, reliability and availability standards.
  • Provide subject matter expertise in HPC storage, file systems and Linux to DST's clients and internal teams.
  • Deploy and maintain cluster management software such as Bright Cluster Manager to streamline administration and operations.
  • Set up, configure, and troubleshoot HPC job schedulers like SLURM, LSF, or UGE to optimize job scheduling and resource allocation.
  • Install, configure and maintain containers, container applications and orchestration tools.
  • Deploy and manage advanced health monitoring systems to ensure the HPC infrastructure is operating efficiently and to preemptively identify issues.
  • Automate software installations and system configurations using Ansible to ensure consistency and efficiency across deployments.
  • Stay up to date with the latest developments in HPC technologies and research new solutions to improve system performance and capabilities.
  • Provide Jira support to maintain and improve DST's project and ticket management.
  • Maintain clear and effective communication with clients, management, and internal teams to ensure project goals and expectations are met.

Skills

Linux administration
HPC cluster design
Networking (InfiniBand & Ethernet)
Slurm scheduling
Bright Cluster Manager
Ansible automation
GPU hardware knowledge
Jira
Communication skills
Containers

Tools

Bright Cluster Manager
Slurm
Ansible

Job description

Primary Responsibilities:
  • Design and implement high-performance computing clusters to ensure they meet the required performance, scalability, reliability and availability standards.
  • Provide subject matter expertise in HPC storage, file systems and Linux to DST's clients and internal teams.
  • Deploy and maintain cluster management software such as Bright Cluster Manager to streamline administration and operations.
  • Set up, configure, and troubleshoot HPC job schedulers like SLURM, LSF, or UGE to optimize job scheduling and resource allocation.
  • Install, configure and maintain containers, container applications and orchestration tools.
  • Deploy and manage advanced health monitoring systems to ensure the HPC infrastructure is operating efficiently and to preemptively identify issues.
  • Automate software installations and system configurations using Ansible to ensure consistency and efficiency across deployments.
  • Stay up to date with the latest developments in HPC technologies and research new solutions to improve system performance and capabilities.
  • Provide Jira support to maintain and improve DST's project and ticket management.
  • Maintain clear and effective communication with clients, management, and internal teams to ensure project goals and expectations are met.
Requirements:
  • Extensive experience with Linux operating systems, including system configuration, troubleshooting, and performance tuning.
  • Advanced expertise with parallel storage systems, InfiniBand, and Ethernet networking to ensure high-performance data transfer and storage solutions.
  • Proven expertise in designing and building HPC clusters from the ground up, including hardware and software integration.
  • Advanced knowledge and hands-on experience with Bright Cluster Manager, Slurm for job scheduling, and Ansible for automation.
  • Intermediate knowledge of GPUs and associated hardware/software, including configuration, optimization, and debugging.
  • Intermediate Jira skills
  • Strong organizational skills to manage multiple projects efficiently and excellent communication skills to interact effectively with various stakeholders
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

HPC Systems Engineer
HPC Systems Engineer

Veriipro • Indianapolis (IN)

On-site
USD 90,000 - 120,000
Senior HPC Architect: Cluster Performance Lead
Senior HPC Architect: Cluster Performance Lead

Data In Science Technologies • United States

Remote
USD 120,000 - 190,000
HPC Systems Engineer
HPC Systems Engineer

Radix Trading • Chicago (IL)

On-site
USD 120,000 - 190,000
Application Engineer II - HPC Systems & Scheduler Administrator
Application Engineer II - HPC Systems & Scheduler Administrator

WCL Group • Wade Hampton (SC)

On-site
USD 72,000 - 80,000
Senior HPC Engineer
Senior HPC Engineer

Quantori • United States

Remote
CAD 90,000 - 130,000
Competitive compensation
Remote or office work
Flexible working hours
+1
HPC Systems Engineer
HPC Systems Engineer

Radix Trading Experienced Job Board • Chicago (IL), New York (NY)

On-site
USD 120,000 - 150,000
High Performance Computing (HPC) Systems Engineer with Security Clearance
High Performance Computing (HPC) Systems Engineer with Security Clearance

PlanIT Group • King of Prussia (PA)

On-site
USD 110,000 - 150,000
HPC Lead Engineer
HPC Lead Engineer

EPAM Systems • United States

Remote
USD 140,000 - 180,000
HPC System Administrator (Top Secret)
HPC System Administrator (Top Secret)

RedLine Performance Solutions, LLC. • Dayton (OH)

Hybrid
USD 90,000 - 130,000
PTO
401k match
Health insurance
HPC Engineer
HPC Engineer

Tata Consultancy Services Limited • Indianapolis (IN)

On-site
USD 75,000 - 80,000
Discretionary annual incentive
Comprehensive medical coverage (M/D/V,
Family support leaves
+6