Site Reliability Engineer - HPC & 24/7 Monitoring

ADP, Inc.; Berkeley (CA); On-site; USD 140,000 - 180,000; Full time

Job summary

National Energy Research Scientific Computing Center (NERSC) in Berkeley, CA is seeking a Site Reliability Engineer to maintain the reliability of HPC facilities and data systems supporting DOE mission programs. This role sits in the Operations Technology Group and focuses on monitoring, automation, and incident response to keep NERSC accessible, reliable, and secure for scientific users.

The position requires 24/7 onsite shifts (Owl schedule) and collaboration with multiple groups.

Qualifications

• Experience in or willingness to work within a 24/7 onsite team environment.
• Experience on Linux shell and working in a command-line environment (SSH).
• Experience with developing tools using programming languages such as C, C++, Perl, Java, or Python.
• Motivated, self-starter who can learn technologies that improve data center management (Kubernetes, Prometheus, Alertmanager).
• Experience with network security: configuring/maintaining ACLs, firewalls.

Responsibilities

• Monitor the NERSC HPC Facility on a 5-day onsite schedule (Owl shift: midnight–8am).
• Review alerts from systems and coordinate with on-call staff.
• Develop and maintain monitoring tools and automation for routine conditions.
• Create software to provide alerts from HPC APIs into the monitoring pipeline.
• Maintain configurations to ensure software runs reliably as demand grows.
• Collaborate with cross-group teams to ensure clear communication and workflows.
• Maintain environmental health, power distribution, and cooling infrastructure monitoring.
• Document outages and maintenance in the trouble ticketing system.

Skills

Linux shell

C/C++

Python

Perl

Java

Scripting

Kubernetes

Prometheus

VictoriaMetrics

Alertmanager

Tools

ServiceNow

Prometheus

VictoriaMetrics

Alertmanager

Job description

National Energy Research Scientific Computing Center (NERSC) in Berkeley, CA is seeking a Site Reliability Engineer to maintain the reliability of HPC facilities and data systems supporting DOE mission programs. This role sits in the Operations Technology Group and focuses on monitoring, automation, and incident response to keep NERSC accessible, reliable, and secure for scientific users.

The position requires 24/7 onsite shifts (Owl schedule) and collaboration with multiple groups.