Onsite Night-Shift SRE for HPC & Data Center

Essnova Solutions, Inc.; Berkeley (CA); On-site; USD 85,000 - 121,000; Full time

Job summary

Essnova Solutions, Inc. is seeking an on-site Operations Engineer to support NERSC at Lawrence Berkeley National Laboratory, overnight five days a week. You will monitor HPC, storage, network, and facility systems and respond to incidents to keep critical infrastructure running.

You will develop monitoring tools, automate responses, document incidents, and collaborate with cross-functional teams to improve reliability of computing resources used by DOE scientists.

Qualifications

• Experience in a 24/7 onsite data center or similar critical installation.
• Hands-on experience with the Linux shell and SSH.
• Experience developing tools with a programming or scripting language such as C, C++, Perl, Java, or Python.
• Knowledge of data communications networks, network protocols, and infrastructure supporting highly available systems.
• Experience with network security, including access control lists and firewalls.
• Ability to work across technical teams to resolve operational issues and support system reliability.
• Strong communication, troubleshooting, and judgment when addressing complex incidents.

Responsibilities

• Monitor HPC, storage, network, and facility systems during the onsite overnight shift. Triage alerts and engage on-call staff as appropriate.
• Maintain continuous operational data collection and document incidents, outages, and maintenance updates in the trouble ticketing system.
• Develop and maintain monitoring tools, alerting integrations, and software that brings HPC system API data into the monitoring pipeline.
• Automate routine responses, improve triage, and identify ways to prevent recurring incidents.
• Configure and maintain applications and tools as data and user demands grow.
• Conduct physical and logical data center walkthroughs, including checks of environmental conditions, power distribution, and cooling infrastructure.
• Coordinate with NERSC teams on incidents, maintenance activities, and operational workflows.
• Use ServiceNow to support service management workflows and customized solutions.

Skills

Linux shell

SSH

C/C++

Perl

Java

Python

Networking

Network security

Teamwork

Communication

Tools

Kubernetes

Prometheus

VictoriaMetrics

Alertmanager

ServiceNow

Job description

Essnova Solutions, Inc. is seeking an on-site Operations Engineer to support NERSC at Lawrence Berkeley National Laboratory, overnight five days a week. You will monitor HPC, storage, network, and facility systems and respond to incidents to keep critical infrastructure running.

You will develop monitoring tools, automate responses, document incidents, and collaborate with cross-functional teams to improve reliability of computing resources used by DOE scientists.