Petabyte-Scale Data Pipeline Architect — Contract (SF On-site)

Gofractional; San Francisco (CA); On-site; USD 137,760 - 413,280; Full time

Job summary

A leading microscopy data solutions company based in San Francisco seeks an experienced expert to design and implement an end-to-end data pipeline. You will manage high-rate data ingest and multi-petabyte storage, ensuring uptime and optimizing performance. Candidates should have extensive experience in designing high-throughput storage systems and be present on-site during the build-out phase. This contract role offers competitive compensation ranging from $100 to $300 per hour.

Qualifications

• 5+ years designing high-throughput storage systems.
• Experience with NVMe RAID and HPC systems.
• Proven track record in multi-petabyte storage deployment.

Responsibilities

• Architect ingest and storage systems for data pipelines.
• Optimize cost and performance for large data storage.
• Maintain uptime for data-handling pipelines.

Skills

High-throughput storage design

HPC pipelines

NVMe RAID/striping

Linux performance tuning

Cloud storage systems (AWS S3)

Networking (25/40/100 GbE)

Job description

A leading microscopy data solutions company based in San Francisco seeks an experienced expert to design and implement an end-to-end data pipeline. You will manage high-rate data ingest and multi-petabyte storage, ensuring uptime and optimizing performance. Candidates should have extensive experience in designing high-throughput storage systems and be present on-site during the build-out phase. This contract role offers competitive compensation ranging from $100 to $300 per hour.