Data Platform Architect — Streaming & Lakehouse

United States Digital Space LLC; Boston (MA); On-site; USD 244,000 - 366,000; Full time

Job summary

United States Digital Space LLC is seeking an experienced Lead/Principal IC to own the data platform architecture—streaming, batch compute, storage, and governance—that underpins autonomous, agent‑driven experiences.

You will design and ship fast, reliable, cost‑efficient systems and set SLOs, drive technical evolution, and mentor senior engineers while collaborating with product, analytics, and ML teams to unlock value for customers.

Qualifications

• 10+ years building and operating distributed data systems with multi-tenant reliability.
• Experience with ingestion/CDC, stream processing, batch orchestration and lakehouse patterns.
• Ability to define SLOs and governance for data freshness, availability and correctness.
• Experience applying ML/GenAI to data platforms with human‑in‑the‑loop review.

Responsibilities

• Design and implement core data platform capabilities (involving ingestion, CDC, streaming, batch orchestration and governance).
• Define and uphold SLOs for data freshness, availability and correctness; conduct readiness reviews and post-incident learning.
• Land data contracts and templates that accelerate development; standardize connectors and schemas.
• Profile, tune, and right‑size systems for performance and cost; collaborate with FinOps on unit economics.
• Partner with product, analytics/ML to expose abstractions and unblock customer value quickly.
• Contribute high‑quality code and reviews; mentor Staff/Sr. engineers across pillars.
• Leverage AI to streamline data workflows and ensure privacy controls.

Skills

Distributed data systems

Kafka/PubSub

Flink/Spark/Beam

Airflow/Dagster

Iceberg/Delta/Hudi

Snowflake/BigQuery

SLOs and reliability

AI in data platforms

Mentoring senior engineers

Cross-team collaboration

Tools

Airflow

Dagster

Iceberg

Delta

Hudi

Snowflake

BigQuery

Job description

United States Digital Space LLC is seeking an experienced Lead/Principal IC to own the data platform architecture—streaming, batch compute, storage, and governance—that underpins autonomous, agent‑driven experiences.

You will design and ship fast, reliable, cost‑efficient systems and set SLOs, drive technical evolution, and mentor senior engineers while collaborating with product, analytics, and ML teams to unlock value for customers.