Lead Deployment Automation for Large-Scale AI GPU Clusters

Crusoe; San Francisco (CA); On-site; USD 250,000 - 300,000; Full time

Benefits offered by this job

Competitive compensation and equity

Paid time off

Health, dental & vision insurance

HSA contributions

Parental leave

401(k) with match

Job summary

Crusoe, a leading AI infrastructure company, seeks a Senior Staff/Principal Deployment Automation Engineer to own deployment automation for large-scale GPU clusters. You will oversee CI/CD infrastructure, testing, and integration across Crusoe’s AI Cloud.

Join a team building scalable, high-performance datacenter solutions in San Francisco Bay Area. Ideal candidates have 12+ years of experience in deployment automation, proficiency in Python/Bash, and deep knowledge of Kubernetes, Docker, and

Qualifications

• 12+ years of experience in deployment automation and AI cloud environments.
• Experience building automated integration testing for an AI Cloud Environment, from low-level Linux systems up to Distributed Control Planes.
• Working knowledge of Kubernetes, Docker, Terraform, and Postgres.
• CI/CD & GitLab: deep knowledge of CI/CD pipelines and GitLab tooling for multi-datacenter releases.
• Configuration management with Ansible, Puppet, Chef, or SaltStack.
• Automation & scripting: strong Python and/or Bash for cluster-wide test scenarios.
• System internals: Linux kernel, PCIe topology, VFIO, memory management (HugePages, IOMMU).
• Distributed GPU ecosystems: NVIDIA CUDA/NCCL and AMD ROCm contexts in multi-node setups.
• Networking: RDMA, RoCE, InfiniBand in virtualized environments.

Responsibilities

• Deployment and Integration Testing Ownership: own deployment and integration testing automation for bare-metal, on-premise systems across Crusoe’s AI Cloud Stack.
• CI/CD Automation and Tooling: build CI/CD platforms to test, iterate, and deploy low-level systems and apps.
• Multi-Node Scaling Validation: design and run large-scale tests across multi-node clusters for linear GPU workload scaling.
• Configuration Management and Observability: manage Linux configurations with GitLab, Ansible, AWX, osquery, etc.
• Deployment Orchestration: create control apps for canary deployments, Blue/Green testing, and auto rollback.
• Cluster Orchestration: maintain automation frameworks in Python/Go to provision and stress-test multi-node environments.
• Automated testing: create test suites using fio, stress-ng, iperf for performance and isolation.

Skills

CI/CD

Python

Bash

Linux kernel internals

CUDA/NCCL

Networking (RDMA/InfiniBand)

Go

Kubernetes

Education

Bachelor’s or Master’s in Computer Science or Electrical Engineering

Tools

GitLab

Ansible

Terraform

Docker

PostgreSQL

AWX

osquery

Job description

Crusoe, a leading AI infrastructure company, seeks a Senior Staff/Principal Deployment Automation Engineer to own deployment automation for large-scale GPU clusters. You will oversee CI/CD infrastructure, testing, and integration across Crusoe’s AI Cloud.

Join a team building scalable, high-performance datacenter solutions in San Francisco Bay Area. Ideal candidates have 12+ years of experience in deployment automation, proficiency in Python/Bash, and deep knowledge of Kubernetes, Docker, and