HPC Engineer

Institute of Foundation Models; Sunnyvale (CA); On-site; USD 49,000 - 76,000; Full time

Benefits offered by this job

Comprehensive medical, dental, and vis

Job summary

MBZUAI seeks an operations-focused professional to cover Abu Dhabi overnight, ensuring 24/7 GPU cluster health and reliability. You will triage incidents, assist researchers, and execute runbooks for recoveries and deployments, enabling world-class AI research environments.

Ideal candidates bring Linux-SRE experience, scripting skills, and familiarity with HPC or cloud infrastructure. This role supports critical research workloads and requires collaboration across teams to maintain stability.

Qualifications

• Bachelor's degree in a related field.
• 2+ years in Linux systems administration, SRE, DevOps, cloud ops, HPC, or infra ops.
• Strong Linux troubleshooting skills and scripting in Python or Bash.

Responsibilities

• Monitor health, performance, and availability of large-scale GPU clusters.
• Respond to incidents and perform first-level triage.
• Support researchers and troubleshoot job failures.
• Execute operational runbooks and recovery procedures.
• Validate deployments, upgrades, and maintenance activities.
• Track infrastructure utilization and operational metrics.
• Develop automation and monitoring tools.
• Contribute to documentation and reporting.

Skills

Linux administration

SRE

DevOps

Python scripting

Education

Bachelors degree in CS/CE/SE/IT/EE/Math/Physics

Tools

Slurm

GPU infrastructure

AWS

Azure

GCP

Grafana/Prometheus

Datadog

Kubernetes

Job description

About MBZUAI

The Institute for Foundation Models (IFM) operates some of the world's largest AI supercomputing environments.

About MBZUAI

The Institute for Foundation Models (IFM) operates some of the world's largest AI supercomputing environments.

Position Summary

This role provides operational coverage during Abu Dhabi overnight hours and serves as a primary point of contact for infrastructure monitoring, incident triage, researcher support, and production operations.

Responsibilities

• Monitor health, performance, and availability of large-scale GPU clusters
• Respond to incidents and perform first-level triage
• Support researchers and troubleshoot job failures
• Execute operational runbooks and recovery procedures
• Validate cluster deployments, upgrades, and maintenance activities
• Track infrastructure utilization and operational metrics
• Develop automation and monitoring tools
• Contribute to documentation and reporting

Education

Bachelor's degree in Computer Science, Computer Engineering, Software Engineering, Information Technology, Electrical Engineering, Mathematics, Physics, or related disciplines.

Experience

• 2+ years in Linux systems administration, SRE, DevOps, cloud operations, HPC, or infrastructure operations
• Strong Linux troubleshooting skills
• Experience with scripting using Python or Bash

Preferred Qualifications

• Slurm
• GPU infrastructure
• AWS, Azure, or GCP
• Grafana, Prometheus, Datadog, or similar tools
• Containers and Kubernetes
• AI/ML infrastructure exposure
• Research computing environments

Benefits Include

• Comprehensive medical, dental, and vision benefits
• Bonus
• 401K Plan
• Generous paid time off, sick leave and holidays
• Paid Parental Leave
• Employee Assistance Program
• Life insurance and disability

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Salary Range

The posted salary range represents the company’s good faith estimate of the compensation for this position upon hire. The actual compensation offered may vary within this range depending on individual qualifications, including but not limited to relevant skills, experience, education, certifications, geographic location, and specific business needs.