Night-Shift Site Reliability Engineer: HPC Data Center Onsite

Essnova Solutions, Inc.; West Virginia; On-site; USD 83,000 - 124,000; Full time

Job summary

Essnova Solutions, Inc. is hiring for a NERSC Operations Tech role at Lawrence Berkeley National Laboratory to monitor HPC, storage, and facility systems during the overnight shift. You will triage alerts, document incidents, and help keep critical systems reliable for scientific users.

The position focuses on developing tooling, automating responses, and coordinating with NERSC teams on incidents and maintenance across a 24/7 onsite environment.

Qualifications

• Experience in, or willingness to work within, a 24/7 onsite team supporting a large data center or other critical installation.
• Hands-on experience with the Linux shell and command-line tools, including SSH.
• Experience developing tools with a programming or scripting language such as C, C++, Perl, Java, or Python, along with knowledge of standard software development practices.
• Knowledge of data communications networks, network protocols, and infrastructure supporting highly available systems.
• Experience with network security, including access control lists and firewalls.
• Ability to work across technical teams to resolve operational issues and support system reliability.

Responsibilities

• Monitor HPC, storage, network, and facility systems during the onsite overnight shift. Triage alerts and engage on-call staff as appropriate.
• Maintain continuous operational data collection and document incidents, outages, and maintenance updates in the trouble ticketing system.
• Develop and maintain monitoring tools, alerting integrations, and software that brings HPC system API data into the monitoring pipeline.
• Automate routine responses, improve triage, and identify ways to prevent recurring incidents.
• Configure and maintain applications and tools as data and user demands grow.
• Conduct physical and logical data center walkthroughs, including checks of environmental conditions, power distribution, and cooling infrastructure.
• Coordinate with NERSC teams on incidents, maintenance activities, and operational workflows.
• Use ServiceNow to support service management workflows and customized solutions.

Skills

Linux shell

SSH

Python

C/C++

Perl

Java

Tools

Kubernetes

Prometheus

VictoriaMetrics

Alertmanager

ServiceNow

Job description

Essnova Solutions, Inc. is hiring for a NERSC Operations Tech role at Lawrence Berkeley National Laboratory to monitor HPC, storage, and facility systems during the overnight shift. You will triage alerts, document incidents, and help keep critical systems reliable for scientific users.

The position focuses on developing tooling, automating responses, and coordinating with NERSC teams on incidents and maintenance across a 24/7 onsite environment.