Senior Storage Architect

CommonAI CIC; Cambridge; On-site; GBP 60,000 - 75,000; Full time

Benefits offered by this job

Competitive salary package

Pension

Professional development opportunities

Networking with tech sector leaders

Vibrant office environment

Job summary

A non-profit organization focused on AI development is seeking an experienced Storage Architect to design and maintain high-performance storage systems for data-driven workloads. The successful candidate will manage distributed storage solutions like Ceph and integrate these with cloud services while ensuring data security and integrity. This is a chance to work in a collaborative environment with opportunities for professional growth and a competitive salary.

Qualifications

• Strong experience in architecting and managing distributed storage solutions.
• Proven experience with Ceph clusters in a production environment.
• Proficient in automation using Bash, Python, or similar languages.

Responsibilities

• Design and maintain storage platforms for AI data pipelines.
• Manage distributed storage systems and troubleshoot issues.
• Ensure data integrity and security in cloud environments.

Skills

Linux system administration

Ceph clusters management

Scripting (Bash, Python)

Container technologies (Docker, Kubernetes)

Data security best practices

Tools

Ceph

Terraform/OpenTofu

Prometheus

Grafana

Job description

CommonAI CIC is a non-profit membership organisation, founded on a belief in collaborative engineering for the safe and responsible development of foundational AI technologies. A place where AI startups, enterprises large and small, public sector bodies and academia can share resources and knowledge, to codevelop and grow businesses, fast.

We support technology-focused start ups, each with unique data management challenges, and are seeking an experienced Storage Architect to help them design, deploy and maintain high-performance storage systems for their AI and data-driven workloads. The successful candidate will combine deep experience architecting and managing distributed, cloud, and tiered storage solutions with strong Linux and automation skills.

In this role you will:

• Design, implement, and maintain storage platforms that support large-scale AI and data pipelines
• Manage distributed storage systems such as Ceph, Lustre, or BeeGFS.
• Oversee tiered storage architectures, optimizing data movement across high-performance, object, and archival tiers.
• Ensure data integrity, availability, and security across on-premises and cloud environments.
• Develop automation and monitoring tools using Bash, Python, or similar scripting languages.
• Manage and secure container images and related storage used for AI and ML workloads.
• Integrate storage systems with public cloud services (AWS, Azure, GCP) and hybrid environments.
• Troubleshoot complex storage and data flow issues, collaborating closely with AI platform and infrastructure teams.
• Contribute to ongoing architecture improvements, performance tuning, and capacity planning.

To be considered candidates should meet most of the following requirements:

• Strong Linux system administration background.
• Proven experience installing, configuring, and maintaining Ceph clusters or similar technologies in a production environment.
• Familiarity with distributed filesystems (e.g., Lustre, BeeGFS) and cloud-based storage services (e.g. EC2).
• Experience with tiered storage management and lifecycle data policies.
• Scripting and automation proficiency (e.g. Bash, Python, Terraform/OpenTofu, Ansible).
• Understanding of data security best practices and compliance considerations.
• Experience working with container technologies (e.g. Docker, Kubernetes) and image storage registries.
• Strong analytical, troubleshooting, communication and documentation skills.

We also value:

• Knowledge of GPU compute environments or AI training infrastructure.
• Experience with monitoring and observability tools (Prometheus, Grafana, etc.).
• Contributions to open-source storage, data management, or infrastructure projects.
• Familiarity with object storage systems (S3, RADOS Gateway, MinIO, etc.).

• A collaborative and supportive work environment.
• The opportunity to have a high impact in a growing organisation.
• Competitive salary package and pension.
• Professional development opportunities.
• Networking opportunities with influential people from across the tech sector and academia.
• A vibrant office environment located a few minutes walk away from Cambridge train station.

CommonAI CIC is an equal opportunity employer and is committed to creating an inclusive and diverse workplace.