Staff Engineer, Petabyte-Scale Distributed Storage

Creandum; New York (NY); On-site; USD 180,000 - 260,000; Full time

Job summary

Modal seeks engineers to design, build, and maintain a high-performance serverless storage layer powering container images, volumes, and checkpoints across data centers. You will tackle distributed object storage with hundreds of petabytes of data, across cloud stores and a CDN, cached locally on NVMe for fast access.

You will improve caching, preloading, and peer-to-peer layers to hide latency, own durability and cost at scale, and work across the stack from disks to distributed storage.

Qualifications

• 5+ years writing production-grade code.
• Experience in high-performance distributed storage or caching at scale.
• Strong cloud skills with object storage and CDNs.
• Solid knowledge of Linux kernel, file systems, and containers.
• Willing to participate in on-call rotations.

Responsibilities

• Build P2P data sharing within a datacenter to reduce ingress.
• Replicate data across multiple blob storage providers.
• Automate garbage collection across petabytes of data.
• Deploy colocated storage clusters to datacenters for high-throughput workloads.

Skills

Distributed systems

High-performance

Cloud skills

Linux kernel knowledge

On-call readiness

Tools

S3-compatible storage

CDN familiarity

Rust

Job description

Modal seeks engineers to design, build, and maintain a high-performance serverless storage layer powering container images, volumes, and checkpoints across data centers. You will tackle distributed object storage with hundreds of petabytes of data, across cloud stores and a CDN, cached locally on NVMe for fast access.

You will improve caching, preloading, and peer-to-peer layers to hide latency, own durability and cost at scale, and work across the stack from disks to distributed storage.