Senior Infrastructure Software Engineer

lightningai

United States

Remote

USD 180,000 - 220,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Comprehensive medical, dental, and vis
401(k) matching
Paid time off and holidays
Annual professional development
Hybrid or remote within the U.S.
Sabbatical after four years

Job summary

LIGHTNING AI in the United States is seeking an experienced infrastructure engineer to join an engineering team building software that operates and manages large-scale GPU and bare-metal compute. This role blends backend software with Linux systems knowledge to automate fleet-wide infrastructure across thousands of servers.

You will design and operate production services, APIs, and tooling to provision, monitor, and decommission infrastructure.

Qualifications

  • 8+ years of professional software or infrastructure engineering experience.
  • Production-grade Python or object-oriented language experience.
  • Strong Linux experience in production environments.
  • Experience building APIs, tooling, or automation for infrastructure scale.
  • Familiarity with container orchestration concepts.
  • Understanding of HPC and bare-metal provisioning.

Responsibilities

  • Design, build, and operate production services, APIs, tooling, and automation that manage bare-metal and GPU infrastructure at scale
  • Develop systems supporting provisioning, configuration, monitoring, maintenance, and decommissioning
  • Build server discovery, provisioning, configuration, validation, and lifecycle management systems that automate fleet bring-up and capacity deployment
  • Integrate infrastructure software with networking, storage, and data center operations to bring new capacity online efficiently
  • Translate recurring operational issues and hardware failure modes into durable improvements in software and tooling
  • Partner with Network, Infrastructure Operations, Data Center, and Platform Engineering teams to define requirements and shape technical direction, including design documents and engineering best practices

Skills

Python
Linux
APIs & automation
Containerization
HPC infrastructure

Tools

PXE/iPXE
BMC
Redfish
IPMI

Job description

Role overview

Join an infrastructure engineering team responsible for the software systems that operate and manage large-scale GPU and bare-metal compute. This software-first role combines backend engineering with Linux systems knowledge to build automation that bridges physical infrastructure with the platforms customers rely on for AI/ML training, inference, and HPC workloads. The work focuses on making fleet-wide infrastructure management more reliable, repeatable, and programmable across thousands of servers, storage systems, and high-performance networks.

Responsibilities
  • Design, build, and operate production services, APIs, tooling, and automation that manage bare-metal and GPU infrastructure at scale
  • Develop systems supporting the full infrastructure lifecycle, including provisioning, configuration, monitoring, maintenance, and decommissioning
  • Build server discovery, provisioning, configuration, validation, and lifecycle management systems that automate fleet bring-up and capacity deployment
  • Integrate infrastructure software with networking, storage, and data center operations to bring new capacity online efficiently
  • Translate recurring operational issues and hardware failure modes into durable improvements in software and tooling
  • Partner with Network, Infrastructure Operations, Data Center, and Platform Engineering teams to define requirements and shape technical direction, including design documents and engineering best practices
Requirements
  • 8+ years of professional software engineering, infrastructure engineering, or related experience
  • Strong software engineering fundamentals with production backend systems built in Python or a comparable object-oriented language
  • Solid Linux experience in production environments
  • Hands-on experience building APIs, tooling, or automation for managing infrastructure at scale
  • Familiarity with containerization and orchestration concepts
  • Understanding of HPC and bare-metal infrastructure fundamentals, including provisioning and out-of-band management
  • Comfort navigating ambiguity and making pragmatic architecture decisions in a fast-paced, high-ownership environment
Nice to have
  • Bare-metal hardware troubleshooting and provisioning experience with technologies such as PXE/iPXE, BMC, Redfish, or IPMI, particularly with Dell hardware
  • Experience with GPU servers in bare-metal or virtualized environments
  • Experience with network switches, routers, and firewalls, particularly SONiC switches, Palo Alto firewalls, or Juniper Networks
  • Familiarity with high-performance storage systems, particularly VAST
  • Prior experience supporting AI/ML or HPC infrastructure at scale
Benefits and work setup
  • Anticipated annual base salary range of $180,000-$220,000 USD, plus discretionary bonus and equity
  • Comprehensive medical, dental, and vision coverage for employees and eligible dependents
  • 401(k) matching (U.S.) and pension contributions (U.K.)
  • Unlimited PTO, company holidays, floating holidays, and a two-week company-wide winter break
  • Paid parental and family leave
  • Annual professional development allowance
  • Wellness and work-from-home stipends
  • Four weeks of paid sabbatical after four years of service
  • Flexible schedules with a hybrid model for office-based teams and complimentary meals at office hubs
  • Fully remote within the U.S. or hybrid at designated office hubs; occasional team and company offsites
  • Visa sponsorship is not available for this role
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Infrastructure Engineer (GPU & Compute)
Infrastructure Engineer (GPU & Compute)

lightningai • United States

Hybrid
USD 180,000 - 220,000
Discretionary bonus
Equity
Medical/dental/vision
+8
Senior Infrastructure Operations Engineer (EMEA)
Senior Infrastructure Operations Engineer (EMEA)

lightningai • United States

Hybrid
USD 180,000 - 240,000
Equity participation
401(k) matching
Pension contributions
+8
Infrastructure Operations Engineer
Infrastructure Operations Engineer

lightningai • United States

Remote
USD 160,000 - 200,000
Medical, dental, vision
401(k) matching
Unlimited PTO
+4
Infrastructure Engineer (Storage)
Infrastructure Engineer (Storage)

lightningai • United States

Hybrid
USD 180,000 - 220,000
Medical coverage
Dental coverage
Vision coverage
+9
Infrastructure Operations Engineer (APAC)
Infrastructure Operations Engineer (APAC)

lightningai • United States

Remote
USD 128,000 - 171,000
Unlimited PTO
Medical, dental, and vision coverage
Retirement savings support
+3
Principal Software Engineer - Fleet Management
Principal Software Engineer - Fleet Management

nscaleoperationsukltd • United States

Remote
USD 240,000 - 400,000
Medical insurance
Dental insurance
Vision coverage
+3
Forward Deployed Engineer
Forward Deployed Engineer

Delos Data Inc • United States

Remote
USD 152,000 - 179,000
Equity
Senior Infrastructure Engineer - GPU Compute
Senior Infrastructure Engineer - GPU Compute

Boundless • United States

Hybrid
USD 175,000 - 250,000
Equity allocation
Remote-first with off-sites
Health, dental, vision
Technical Program Manager, Infrastructure Delivery
Technical Program Manager, Infrastructure Delivery

lightningai • United States

Hybrid
USD 160,000 - 220,000
Discretionary bonus
Meaningful equity
Unlimited PTO
+5
Infrastructure Software Engineer
Infrastructure Software Engineer

Doghouse Recruitment • United States

Remote
USD 150,000 - 210,000
Health Insurance
401(k) Plan
Parental Leave
+2