Remote Senior Data Engineer - Oil & Gas Data Lakehouse

Itmates; United States; Vor Ort; USD 120.000 - 180.000; Vollzeit

Zusammenfassung

Itmates is seeking a senior data engineer to design and operate data pipelines that move well, production, and sensor data from the field into a cloud lakehouse used by engineers and analysts.

You will ingest time-series data from SCADA/PI/OPC UA alongside ERP sources, and build batch and streaming pipelines on Databricks or Snowflake using Spark, Kafka and Airflow. You will model data in a medallion architecture for analytics and enforce data quality, lineage, and access controls.

Qualifikationen

• 5+ years in data engineering.

Aufgaben

• Ingest time-series data from SCADA and historians (OSIsoft PI, OPC UA) alongside ERP and production accounting sources.
• Build batch and streaming pipelines on Databricks or Snowflake with Spark, Kafka and Airflow.
• Model data in a medallion architecture for production, drilling and maintenance analytics.
• Enforce data quality, lineage and access controls.
• Work with reservoir and production engineers to turn their questions into datasets.
• Optimize pipeline cost and performance.

Kenntnisse

Data engineering

SQL

Python

Spark

Databricks

Snowflake

Kafka

Airflow

dbt

Azure

AWS

Time-series

English

Spanish/Portuguese

Tools

Databricks

Snowflake

Spark

Kafka

Airflow

dbt

OSIsoft PI

OPC UA

Azure

AWS

Jobbeschreibung

Itmates is seeking a senior data engineer to design and operate data pipelines that move well, production, and sensor data from the field into a cloud lakehouse used by engineers and analysts.

You will ingest time-series data from SCADA/PI/OPC UA alongside ERP sources, and build batch and streaming pipelines on Databricks or Snowflake using Spark, Kafka and Airflow. You will model data in a medallion architecture for analytics and enforce data quality, lineage, and access controls.