AI Storage Architect: High-Performance, Distributed Systems

CommonAI CIC; Cambridge; On-site; GBP 65,000 - 90,000; Full time

Benefits offered by this job

Competitive salary package

Pension

Job summary

CommonAI CIC is seeking an experienced Infrastructure Engineer to design, deploy and maintain high‑performance storage for AI and data workloads. You will combine Linux expertise with automation to deliver scalable, secure storage across on‑premises and cloud environments.

You will manage distributed storage systems such as Ceph, Lustre, or BeeGFS, optimise tiered storage, and ensure data integrity and availability while collaborating with AI platform and infrastructure teams.

Qualifications

• Proven experience installing, configuring, and maintaining Ceph clusters in production.
• Familiarity with Lustre or BeeGFS and cloud storage services.
• Scripting and automation with Bash and Python; IaC tools like Terraform or Ansible.
• Understanding of data security and compliance best practices.
• Experience with containerized workloads and image registries (Docker/Kubernetes).

Responsibilities

• Design and maintain storage platforms for AI/data workloads.
• Manage distributed storage systems (Ceph, Lustre, BeeGFS).
• Oversee tiered storage and data movement across storage tiers.
• Ensure data integrity, availability, security across on‑prem and cloud.
• Develop automation/monitoring scripts; integrate with cloud services.
• Collaborate with AI platform and infra teams on performance and capacity.

Skills

Linux system administration

Analytical problem solving

Documentation

Communication

Tools

Ceph

Lustre

BeeGFS

Docker

Kubernetes

Terraform/OpenTofu

Ansible

AWS

Azure

GCP

S3 / MinIO / RADOS Gateway

Job description

CommonAI CIC is seeking an experienced Infrastructure Engineer to design, deploy and maintain high‑performance storage for AI and data workloads. You will combine Linux expertise with automation to deliver scalable, secure storage across on‑premises and cloud environments.

You will manage distributed storage systems such as Ceph, Lustre, or BeeGFS, optimise tiered storage, and ensure data integrity and availability while collaborating with AI platform and infrastructure teams.