Senior AI Infra Network Reliability Engineer

Crusoe; San Francisco (CA); On-site; USD 165,000 - 200,000; Full time

Benefits offered by this job

Health insurance

401(k) Retirement plan with company/PR

Paid time off

Employee stock units (RSUs)

Parental leave

Professional development

Commuter benefits

Job summary

Crusoe is seeking a Senior Network Production Operations Engineer to ensure production reliability across a global network infrastructure, including edge, backbone, data centers, and GPU clusters. The role emphasizes incident response, RCAs, and automation-driven execution to keep AI workloads running at scale.

The ideal candidate has 5+ years in production network engineering, strong Python skills, and hands-on experience with observability tools and data-center networking protocols.

Qualifications

• 5+ years of production network engineering experience in large-scale environments.
• Strong Python scripting and tooling development ability.
• Hands-on experience with observability and monitoring tools (Grafana, Prometheus, ThousandEyes).
• Experience operating RDMA/RoCE fabrics for GPU/HPC workloads and knowledge of TCP/IP and routing protocols in data centers.

Responsibilities

• Support uptime across Crusoe's global network including edge, backbone, data center, and GPU cluster networks.
• Develop Python-based tooling to reduce toil and automate remediation workflows.
• Participate in high-severity network events: detection, triage, mitigation, and postmortems.
• Perform root cause analysis and drive remediation items to closure.
• Build and maintain dashboards and alerts for SLI/SLOs with cross-functional teams.
• Collaborate with Architecture and SRE to improve operational standards.

Skills

Python scripting

Incident response

Network reliability

SRE practices

Education

Bachelor’s degree in Computer Science / Electrical Engineering or related field

Tools

Grafana

Prometheus

ThousandEyes

NetFlow

SNMP

Kentik

Arista EOS

Juniper Junos

Job description

Crusoe is seeking a Senior Network Production Operations Engineer to ensure production reliability across a global network infrastructure, including edge, backbone, data centers, and GPU clusters. The role emphasizes incident response, RCAs, and automation-driven execution to keep AI workloads running at scale.

The ideal candidate has 5+ years in production network engineering, strong Python skills, and hands-on experience with observability tools and data-center networking protocols.