Software Engineer, GPU Infrastructure - HPC

Cloudjobs; New York (NY); On-site; USD 120,000 - 160,000; Full time

Job summary

Cloudjobs in New York seeks a reliability engineer to ensure uptime and reliability of a large-scale compute fleet. You will build automation for provisioning, health monitoring, and incident response to minimize outages.

The role requires deep system knowledge, strong Linux and networking fundamentals, experience with server hardware, and proficiency in Python or Go. Collaboration with cross-functional teams is essential to maintain highly available infrastructure.

Qualifications

• Experience managing large-scale server environments.
• Proficiency in Python or Go.
• Strong knowledge of Linux, networking and server hardware.
• Ability to deep-dive into system-level investigations.

Responsibilities

• Build automation for provisioning and scaling of servers.
• Monitor health and performance of compute fleet.
• Identify and fix bottlenecks to improve uptime.

Skills

Python

Go

Linux

SQL

PromQL

Pandas

HPC

Distributed Systems

Server Hardware

Networking

Automation

Prometheus

Grafana

IPMI

Redfish

PCIe

Job description

The role focuses on ensuring the reliability and uptime of OpenAI's compute fleet by minimizing hardware failures. Responsibilities include building automation for server provisioning, monitoring health, and fixing performance bottlenecks.

Requirements: Candidates should have experience managing large-scale server environments and proficiency in Python or Go. Strong knowledge of Linux, networking, and server hardware is required, with a capacity for deep system-level investigation.

Key Skills: Python, Go, Linux, SQL, PromQL, Pandas, HPC, Distributed Systems, Server Hardware, Networking, Automation, Prometheus, Grafana, IPMI, Redfish, PCIe