Senior Data Systems Engineer: Scale, Provenance & AI Data

Jobtailor; Boston (MA); On-site; USD 160,000 - 210,000; Full time

Job summary

Jobtailor seeks an experienced data infrastructure leader to own the end-to-end data platform for scientific results. You will manage transactional databases, analytics paths, and storage systems while scaling catalogs for billions of objects.

You will design lineage, provenance, and rights tracking, optimize tiered storage across clouds, and drive reproducibility from spec to deployment in a complex, multi-cloud environment.

Qualifications

• 5+ years building data infrastructure in production at engineering-rigorous companies.
• Broad data-infrastructure experience across databases, storage systems, filesystems, catalogs, and data platforms.
• Experience owning platforms, not just pipelines or administration.
• Understanding of immutable content, versioned names, provenance, rights enforcement, and retention in data paths.
• Experience diagnosing catalog, namespace, or metadata-service failures before storage failures.
• Ability to produce replicate-versus-fetch break-even analyses and defend storage-tiering in dollar terms.
• Content-addressed storage, data versioning, or lineage systems in production preferred.
• GPU-scale checkpointing experience preferred.
• Distributed-systems experience with schedulers or workflow engines preferred.
• Scientific or research-data experience preferred.
• Experience with table formats, catalogs at scale, and multi-cloud data placement preferred.
• Willingness to work in or relocate to the Boston-based role; remote consideration case-by-case.

Responsibilities

• Build the data plane for scientific results at scale, including content addressing, write-time lineage, and rights metadata.
• Scale catalogs and query paths for billion-object corpora.
• Own transactional databases, analytical query paths, filesystems, schema evolution, and database-engine selection.
• Own ingestion and shared access for scientific corpora and public data feeds.
• Model and manage replicate-versus-fetch economics across storage tiers and clouds.
• Build versioned, rights-tracked, lineaged training sets, evaluation corpora, and captured traces for AI.
• Design systems so results remain traceable and reproducible.
• Take ownership from specification through deployment and on-call.

Skills

Data Infrastructure Development

Transactional Database Management

Content-Addressed Storage

Distributed Systems Experience

Scientific Data Management

Tools

Workflow Engines

Schedulers

Multi-Cloud Data Placement

Filesystems

Analytical Query Paths

Job description

Jobtailor seeks an experienced data infrastructure leader to own the end-to-end data platform for scientific results. You will manage transactional databases, analytics paths, and storage systems while scaling catalogs for billions of objects.

You will design lineage, provenance, and rights tracking, optimize tiered storage across clouds, and drive reproducibility from spec to deployment in a complex, multi-cloud environment.