Remote GPU Infra Engineer for Large-Scale Compute

lightningai; United States; Hybrid; USD 180,000 - 220,000; Full time

Benefits offered by this job

Discretionary bonus

Equity

Medical/dental/vision

401(k) matching

Pension contributions

Unlimited PTO

Sabbatical after 4 years

Professional development allowance

Wellness stipend

Hybrid work model

In-office meals

Job summary

lightningai is seeking an experienced infrastructure engineer to bring up and validate large-scale GPU-enabled bare-metal compute environments. You will own image management, deployment pipelines, and diagnostics across hardware, firmware, and OS levels.

You will operate test clusters, build Python automation for provisioning, and collaborate with data center teams to ensure systems meet demanding AI/ML workloads. Remote and hybrid US work options apply.

Qualifications

• 5+ years in infrastructure engineering, systems engineering, or a closely related role.
• Strong Linux systems experience in production environments.
• Hands-on experience with GPU-enabled systems and diagnostic tooling such as NVIDIA DCGM.
• Familiarity with bare-metal provisioning and system bring-up workflows.
• Proficiency in Python or comparable scripting/programming languages for automation.
• Ability to debug complex issues across hardware, OS, GPUs, and system software.

Responsibilities

• Own and evolve image management, deployment, and validation pipelines across bare-metal infrastructure, including firmware, driver, and OS qualification for GPU-enabled systems.
• Operate and maintain test clusters used for bring-up and diagnostics, supporting hardware qualification efforts for next-generation platforms.
• Diagnose and resolve complex issues spanning GPUs, drivers, OS, and underlying hardware; analyze performance using tools such as NVIDIA DCGM.
• Build Python-based automation for provisioning, validation, and system bring-up, improving reliability, repeatability, and scalability.
• Manage Linux-based production and validation environments, including virtualization and PXE/image-based bare-metal provisioning workflows.
• Partner with infrastructure, hardware, and data center teams, plus platform and ML stakeholders, to ensure systems meet workload requirements and contribute to provisioning and lifecycle best practices.

Skills

Linux systems

Python automation

GPU engineering

Diagnostics

System bring-up

Tools

NVIDIA DCGM

PXE boot

IPMI/Redfish

InfiniBand

NVLink

Job description

lightningai is seeking an experienced infrastructure engineer to bring up and validate large-scale GPU-enabled bare-metal compute environments. You will own image management, deployment pipelines, and diagnostics across hardware, firmware, and OS levels.

You will operate test clusters, build Python automation for provisioning, and collaborate with data center teams to ensure systems meet demanding AI/ML workloads. Remote and hybrid US work options apply.