Data Platform Engineer: Build the Factory Data Backbone

Socket.dev; Los Angeles (CA); On-site; USD 170,000 - 300,000; Full time

Benefits offered by this job

Health insurance

401k

Relocation support

Flexible vacation

Equity

Job summary

Hadrian, a leader in autonomous manufacturing, seeks a Data Platform Engineer to own data pipelines from source to trusted datasets, shaping ingestion, CDC, streaming, and lakehouse storage to empower analytics, ML, and operations across factory floors.

You will collaborate with teams to integrate machines, PLCs, historians, and industrial protocols, prioritizing reliability, scale, and observability in a rapidly growing company.

Qualifications

• Experience building and operating production data infrastructure or distributed data systems, including on-call ownership and recovery.
• Strong production Python and advanced SQL and data-modeling skills, including incremental processing, temporal data, and schema evolution.
• Experience with Kafka or another event-streaming platform, plus CDC or other stateful incremental pipelines.
• Experience operating Snowflake, and with a lakehouse table format such as Iceberg, Delta, or Hudi, including expertise in partitioning and compaction.
• Experience with tools such as Dagster, Airflow, Argo, or Prefect; dbt or similar transformation frameworks; and Kubernetes or infrastructure as code.
• Strong judgment regarding contracts, failure modes, and the needs of downstream analytics, ML, and operational systems.

Responsibilities

• Build the data backbone for autonomous factories, transforming machine signals, quality events, work orders, and application changes into trusted data used by scheduling, ML, and operations.
• Create ingestion, CDC, and streaming capabilities for transactional data, events, telemetry, and files with careful ordering, retries, and idempotence.
• Define versioned data and event contracts with upstream teams, ensuring freshness, completeness, and correctness.
• Model telemetry, quality events, work orders, and operational data into datasets with clear grain, identity, time, provenance, and history.
• Own Dagster orchestration, dbt transforms, data CI/CD, backfills, lineage, observability, and offline feature datasets for ML.
• Collaborate with Manufacturing Operations and Infrastructure to access data from machines, PLCs, OPC-UA, MTConnect, MQTT as needed.

Skills

Production Python

Advanced SQL

Data modeling

Incremental processing

Temporal data

Schema evolution

Kafka

CDC

Snowflake

Iceberg

Delta

Hudi

dbt

Dagster

Airflow

Argo

Prefect

Kubernetes

IaC

Contracts

Tools

Dagster

Airflow

Argo

Prefect

dbt

Kubernetes

IaC

Job description

Hadrian, a leader in autonomous manufacturing, seeks a Data Platform Engineer to own data pipelines from source to trusted datasets, shaping ingestion, CDC, streaming, and lakehouse storage to empower analytics, ML, and operations across factory floors.

You will collaborate with teams to integrate machines, PLCs, historians, and industrial protocols, prioritizing reliability, scale, and observability in a rapidly growing company.