Data Engineer – Oil & Gas

Itmates; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Itmates is seeking a senior data engineer to design and operate data pipelines that move well, production, and sensor data from the field into a cloud lakehouse used by engineers and analysts.

You will ingest time-series data from SCADA/PI/OPC UA alongside ERP sources, and build batch and streaming pipelines on Databricks or Snowflake using Spark, Kafka and Airflow. You will model data in a medallion architecture for analytics and enforce data quality, lineage, and access controls.

Qualifications

• 5+ years in data engineering.

Responsibilities

• Ingest time-series data from SCADA and historians (OSIsoft PI, OPC UA) alongside ERP and production accounting sources.
• Build batch and streaming pipelines on Databricks or Snowflake with Spark, Kafka and Airflow.
• Model data in a medallion architecture for production, drilling and maintenance analytics.
• Enforce data quality, lineage and access controls.
• Work with reservoir and production engineers to turn their questions into datasets.
• Optimize pipeline cost and performance.

Skills

Data engineering

SQL

Python

Spark

Databricks

Snowflake

Kafka

Airflow

dbt

Azure

AWS

Time-series

English

Spanish/Portuguese

Tools

Databricks

Snowflake

Spark

Kafka

Airflow

dbt

OSIsoft PI

OPC UA

Azure

AWS

Job description

Client: oil and gas company (upstream operator, Houston HQ) · Location: remote, LATAM, Houston business hours · Level: senior · Engagement: full-time contractor

You will build the pipelines that move well, production and sensor data from the field into a cloud lakehouse used by engineers and analysts.

What you will do

• Ingest time-series data from SCADA and historians (OSIsoft PI, OPC UA) alongside ERP and production accounting sources
• Build batch and streaming pipelines on Databricks or Snowflake with Spark, Kafka and Airflow
• Model data in a medallion architecture for production, drilling and maintenance analytics
• Enforce data quality, lineage and access controls
• Work with reservoir and production engineers to turn their questions into datasets
• Optimize pipeline cost and performance

What you bring

• 5+ years in data engineering
• Strong SQL and Python, plus Spark in production
• Experience on Azure or AWS data stacks
• Orchestration with Airflow or similar, and dbt for transformations
• Experience with high-volume time-series or IoT data
• Advanced English
• Nice to have Oil and gas domain knowledge (WITSML, PPDM, OSDU)
• PI System integration experience
• Spanish or Portuguese for work with LATAM operations

Originally posted on Himalayas