Site Reliability Engineer - HPC & 24/7 Monitoring

ADP, Inc.

Berkeley (CA)

On-site

USD 140,000 - 180,000

Full time

6 days ago

Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

National Energy Research Scientific Computing Center (NERSC) in Berkeley, CA is seeking a Site Reliability Engineer to maintain the reliability of HPC facilities and data systems supporting DOE mission programs. This role sits in the Operations Technology Group and focuses on monitoring, automation, and incident response to keep NERSC accessible, reliable, and secure for scientific users.

The position requires 24/7 onsite shifts (Owl schedule) and collaboration with multiple groups.

Qualifications

Experience in or willingness to work within a 24/7 onsite team environment.
Experience on Linux shell and working in a command-line environment (SSH).
Experience with developing tools using programming languages such as C, C++, Perl, Java, or Python.
Motivated, self-starter who can learn technologies that improve data center management (Kubernetes, Prometheus, Alertmanager).
Experience with network security: configuring/maintaining ACLs, firewalls.

Responsibilities

Monitor the NERSC HPC Facility on a 5-day onsite schedule (Owl shift: midnight–8am).
Review alerts from systems and coordinate with on-call staff.
Develop and maintain monitoring tools and automation for routine conditions.
Create software to provide alerts from HPC APIs into the monitoring pipeline.
Maintain configurations to ensure software runs reliably as demand grows.
Collaborate with cross-group teams to ensure clear communication and workflows.
Maintain environmental health, power distribution, and cooling infrastructure monitoring.
Document outages and maintenance in the trouble ticketing system.