Autonomous Factory Data Platform Engineer

Hadrian Automation; Santa Monica (CA); On-site; USD 170,000 - 300,000; Full time

Benefits offered by this job

Medical, dental, vision insurance

401k

Relocation support

Flexible vacation

Equity

Job summary

Hadrian is hiring a Data Platform Engineer to own data flow from source systems to trusted datasets used by Analytics, Data Science, and ML. You will build ingestion, CDC, streaming, and lakehouse storage, with contracts and quality controls, collaborating with Operations and Infrastructure to integrate from PLCs and historians.

You will work with Dagster, dbt, and Kubernetes, ensuring reliable datasets and scalable pipelines for autonomous factory data.

Qualifications

• Experience building production data infrastructure and handling on-call incidents.
• Strong production Python and advanced SQL with data-modeling skills.
• Familiarity with event streaming and CDC pipelines.
• Experience with Snowflake and lakehouse architectures.
• Knowledge of Dagster, Airflow, Argo, or Prefect; Kubernetes or IaC.

Responsibilities

• Own data flow from source to trusted datasets for analytics and ML.
• Develop ingestion, CDC, streaming, and lakehouse storage capabilities.
• Define versioned contracts and ensure data freshness and completeness.
• Model telemetry and operational data with clear provenance and history.
• Oversee orchestration, dbt transformations, and data CI/CD.

Skills

Python

SQL

Kafka

Dagster

DBT

Cloud data modeling

Data quality

Go/Rust/Scala

Machine-learning data

Tools

Dagster

Airflow

Argo

Prefect

Kubernetes

dbt

Job description

Hadrian is hiring a Data Platform Engineer to own data flow from source systems to trusted datasets used by Analytics, Data Science, and ML. You will build ingestion, CDC, streaming, and lakehouse storage, with contracts and quality controls, collaborating with Operations and Infrastructure to integrate from PLCs and historians.

You will work with Dagster, dbt, and Kubernetes, ensuring reliable datasets and scalable pipelines for autonomous factory data.