Senior Storage Reliability Engineer — AI Cloud (Onsite 4x/wk)

Socket.dev; San Francisco (CA); On-site; USD 140,000 - 210,000; Full time

Benefits offered by this job

Health coverage

Dental coverage

Vision coverage

401k with match

Wellness stipend

Commuter stipend

Job summary

Lambda is building the world's best AI cloud. We seek a Storage Engineer to own reliability and capacity for our production storage fleet, spanning on-site data centers and a software-defined data plane. You will automate, monitor, and optimize performance across multiple sites, collaborating with hardware, networking, and release teams.

You will drive incident response, build dashboards, and implement self-healing automation while advancing CI/CD for storage tooling and integrations.

Qualifications

• 5+ years operating Linux systems in production or HPC environments.
• Hands-on storage experience at scale on software-defined platforms.
• Strong incident-response ownership from alert to postmortem.
• Experience with monitoring/logging: Prometheus, Grafana, Datadog, Sumo Logic.
• Kubernetes experience including GitOps tools like ArgoCD, Helm, Kustomize.
• CI/CD tooling: GitHub Actions, Jenkins, BuildKite; Docker/Podman.
• Programming in Python or Go; Infrastructure as Code with Terraform/Ansible.
• Core storage protocols: NFS, SMB, S3, NVMe-oF; basic DB concept.

Responsibilities

• Own reliability, performance, and capacity health of production storage fleet.
• Build and maintain monitoring, dashboards, and alerting for storage systems.
• Investigate and resolve storage incidents using telemetry and profiling.
• Automate ticketing, escalation, and incident-response workflows.
• Design self-healing automation for drive replacements, node swaps, rebuilds.
• Implement CI/CD pipelines for storage automation and tooling.
• Collaborate with Storage Engineers, Fleet Orchestration, Release Engineering.
• Work with hardware and networking teams to diagnose low-level I/O issues.
• Participate in on-call rotations to minimize MTTR.

Skills

Linux production systems

Storage at scale (SDS)

Incident response

Monitoring dashboards

Kubernetes

CI/CD tooling

Python/Go

Infrastructure as code

Storage protocols

Education

Bachelor's degree in Computer Science or related field

Tools

Prometheus

Grafana

Alertmanager

Datadog

Sumo Logic

Kubernetes

ArgoCD

Helm

Kustomize

GitHub Actions

Jenkins

BuildKite

Docker

Terraform

Ansible

Job description

Lambda is building the world's best AI cloud. We seek a Storage Engineer to own reliability and capacity for our production storage fleet, spanning on-site data centers and a software-defined data plane. You will automate, monitor, and optimize performance across multiple sites, collaborating with hardware, networking, and release teams.

You will drive incident response, build dashboards, and implement self-healing automation while advancing CI/CD for storage tooling and integrations.