AI Storage Infrastructure Engineer (Remote/Hybrid)

Lightningai; Greater London; Hybrid; GBP 135,000 - 165,000; Full time

Benefits offered by this job

Comprehensive Health Coverage

Meaningful Equity

Retirement Savings

Unlimited PTO

Hybrid work model

Winter Break (2 weeks)

Parental & Family Leave

Learning & Development allowance

Wellness stipend

Sabbatical after 4 years

Office meals

Job summary

Lightning AI is seeking a Storage Infrastructure Engineer to build and operate storage systems powering large-scale AI/ML training, inference, and HPC workloads. You will work at the intersection of software, hardware, and operations, developing automation, improving reliability, and scaling distributed storage across our bare-metal infrastructure.

You’ll own the data plane of our storage stack (including VAST and Ceph/S3-compatible systems), ensuring high throughput, low latency, and efficient

Qualifications

• 5+ years of experience in infrastructure engineering, systems engineering, or related roles.
• Hands-on experience operating distributed storage systems (e.g., VAST, Ceph, or similar).
• Strong Linux systems experience in production environments.
• Proficiency in Python or similar scripting/programming languages for automation.
• Experience working with bare-metal infrastructure and hardware-oriented systems.
• Ability to debug complex issues across system boundaries (storage, OS, hardware, networking).
• Experience with storage networking protocols (e.g., NFS or similar).
• Experience with capacity planning, monitoring, and performance tuning.

Responsibilities

• Operate and scale distributed storage systems, including VAST and S3-compatible object storage (e.g., Ceph)
• Improve performance, reliability, and efficiency of storage systems supporting large-scale AI/ML workloads
• Troubleshoot complex storage and data path issues across hardware and software layers
• Optimize storage performance to support high-throughput, low-latency AI training and inference workloads
• Build and maintain automation for provisioning, managing, and monitoring storage infrastructure
• Develop Python-based tools and workflows to reduce manual operational overhead
• Improve lifecycle management of storage clusters, from deployment through maintenance and scaling
• Manage and operate Linux-based systems in production, including bare‑metal environments
• Partner with infrastructure and data center teams on hardware bring‑up, upgrades, and issue resolution
• Support capacity planning, utilization tracking, and forecasting for storage systems
• Leverage monitoring and telemetry to diagnose issues and improve system performance and reliability
• Work closely with Infrastructure Engineering, Network Engineering, and Platform teams to integrate storage into the broader platform
• Contribute to design discussions around new infrastructure deployments and scaling strategies
• Help define best practices for operating storage systems in high-performance computing environments

Skills

5+ years experience

Linux

Python

Debugging across system boundaries

NFS storage networking

Tools

VAST

Ceph

Bare-metal infrastructure

Job description

Lightning AI is seeking a Storage Infrastructure Engineer to build and operate storage systems powering large-scale AI/ML training, inference, and HPC workloads. You will work at the intersection of software, hardware, and operations, developing automation, improving reliability, and scaling distributed storage across our bare-metal infrastructure.

You’ll own the data plane of our storage stack (including VAST and Ceph/S3-compatible systems), ensuring high throughput, low latency, and efficient