Data Platform Engineer - Factory Data Backbone for AI

Multicoin; Los Angeles (CA); On-site; USD 170,000 - 300,000; Full time

Benefits offered by this job

Medical, dental, vision, and life 보험

401k

Relocation support

Flexible vacation

Equity

Job summary

Hadrian in the United States is seeking a Data Platform Engineer to own the data flow from source to trusted datasets, enabling analytics, data science, and manufacturing operations across autonomous facilities.

You will build ingestion, CDC, streaming, lakehouse storage, and orchestration, ensuring data quality and lineage. Collaboration with Operations and Infrastructure to integrate machines and industrial protocols is essential.

Qualifications

• Experience building and operating production data infrastructure or distributed data systems.
• Strong production Python and advanced SQL and data-modeling skills, including incremental processing, temporal data, and schema evolution.
• Experience with Kafka or another event-streaming platform, plus CDC or other stateful incremental pipelines.
• Experience operating Snowflake, and with a lakehouse table format such as Iceberg, Delta, or Hudi, including expertise in partitioning and compaction.
• Experience with Dagster, Airflow, Argo, or Prefect; dbt or similar transformation frameworks; and Kubernetes or infrastructure as code.
• Strong judgment regarding contracts, failure modes, and the needs of downstream analytics, ML, and operational systems.

Responsibilities

• Build the data backbone for autonomous factories, transforming machine signals, quality events, work orders, and application changes into trusted data used by scheduling, ML, and operations.
• Build ingestion, CDC, and streaming capabilities for transactional data, events, telemetry, and files; explicitly manage ordering, deletes, retries, replay, idempotence, and backpressure.
• Define versioned data and event contracts with upstream teams, supported by testing and service targets for freshness, completeness, and correctness.
• Model telemetry, quality events, work orders, and operational data into datasets with explicit grain, identity, time, provenance, and history.
• Own Dagster orchestration, dbt transformation, data CI/CD, backfills, lineage, observability, and offline feature datasets for ML.
• Collaborate with Manufacturing Operations and Infrastructure to acquire data from machines, PLCs, historians, OPC-UA, MTConnect, and MQTT sources as needed.

Skills

Python

SQL

Data modeling

Kafka

Snowflake

Dagster

Airflow

Argo

Prefect

dbt

Kubernetes

Go/Rust/Scala

Contract design

Tools

Dagster

Airflow

Argo

Prefect

dbt

Kubernetes

Job description

Hadrian in the United States is seeking a Data Platform Engineer to own the data flow from source to trusted datasets, enabling analytics, data science, and manufacturing operations across autonomous facilities.

You will build ingestion, CDC, streaming, lakehouse storage, and orchestration, ensuring data quality and lineage. Collaboration with Operations and Infrastructure to integrate machines and industrial protocols is essential.