Linux Infrastructure Engineer (Bare Metal, Storage & AI Factory Infrastructure) (Fully Remote)

Unknown

United States

Remote

USD 110,000 - 170,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Unknown is seeking a seasoned infrastructure engineer to design and deploy bare metal servers, and to build scalable GPU clusters for AI/ML workloads. You will manage enterprise storage platforms such as Ceph, WEKA, and NVMe-oF while providing expert-level Linux administration for multiple distros.

You will troubleshoot production issues, develop runbooks and SOPs, and work with Kubernetes, Ansible, and observability tools to optimize operations across BMaaS, HPC, and AI Factory environments.

Qualifications

  • Extensive hands-on experience designing and deploying bare metal infrastructure.
  • Proven ability to manage lifecycle of large-scale server fleets.
  • Experience building and tuning GPU clusters for AI/ML workloads.
  • Deep Linux administration skills across multiple distros (Ubuntu, RHEL, SUSE).
  • Strong troubleshooting of hardware, storage, networking, and OS in production.
  • Development of runbooks and SOPs for incident response and disaster recovery.

Responsibilities

  • Design and architect bare metal server deployments and lifecycle workflows.
  • Deploy and optimize GPU clusters for AI/ML using NVIDIA tech.
  • Manage storage platforms like Ceph, WEKA, and NVMe-oF across environments.
  • Provide expert Linux admin across Ubuntu, Red Hat, and SUSE.
  • Troubleshoot production hardware/storage/network/OS issues; document procedures.

Skills

Bare metal deployments
Lifecycle management
GPU cluster design
Linux administration
Production troubleshooting
Runbooks/SOPs

Tools

Kubernetes
Ansible
Observability tools
Ceph
WEKA
NVMe-oF
NVIDIA technologies
BMaaS
HPC

Job description

  • Design and architect bare metal server deployments, provisioning, and lifecycle management.
  • Deploy and optimize GPU clusters for AI/ML with NVIDIA technologies.
  • Manage enterprise storage platforms including Ceph, WEKA, and NVMe-oF.

Infrastructure Operations:

  • Provide expert-level Linux administration for Ubuntu, Red Hat, and SUSE.
  • Troubleshoot hardware, storage, networking, and OS issues in production.
  • Develop runbooks, SOPs, and disaster recovery plans.

Preferred Experience:

  • Hands-on with BMaaS, HPC, and AI Factory environments.
  • Familiarity with Kubernetes, Ansible, and observability tools.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Bare Metal Infrastructure Engineer for AI & Storage
Bare Metal Infrastructure Engineer for AI & Storage

Unknown • United States

Remote
USD 110,000 - 170,000
Linux Infrastructure Engineer (Bare Metal, Storage & AI Factory Infrastructure)
Linux Infrastructure Engineer (Bare Metal, Storage & AI Factory Infrastructure)

Uvation • Las Vegas (NV)

On-site
USD 140,000 - 180,000
Senior Linux Infrastructure Engineer (Bare metal & storage)
Senior Linux Infrastructure Engineer (Bare metal & storage)

Uvation • United States

On-site
USD 90,000 - 120,000
Infrastructure Engineer
Infrastructure Engineer

ITCO Solutions, Inc. • United States

Remote
USD 120,000 - 180,000
AI GPU Infrastructure Operations Architect
AI GPU Infrastructure Operations Architect

Accrescent Group • San Francisco (CA)

On-site
USD 150,000 - 230,000
Linux Infrastructure Engineer
Linux Infrastructure Engineer

Eqvilentjobs • United States

Remote
USD 120,000 - 180,000
Remote work from anywhere in the world
Flexible schedule
Competitive salary
+2
AI Infrastructure Operations Engineer - Compute & Storage (Fully Remote)
AI Infrastructure Operations Engineer - Compute & Storage (Fully Remote)

Highrise AI • United States

Hybrid
USD 90,000 - 130,000
Principal AI Infrastructure Engineer (Fully Remote)
Principal AI Infrastructure Engineer (Fully Remote)

Highrise AI • United States

Remote
USD 140,000 - 200,000
AI Factory Platform Operations Engineer
AI Factory Platform Operations Engineer

Accrescent Group • San Francisco (CA)

On-site
USD 180,000 - 280,000
Senior Solutions Engineer, AI Infrastructure
Senior Solutions Engineer, AI Infrastructure

VAST Data • New York (NY)

On-site
USD 150,000 - 200,000