Data Engineer

Sutherland; Al Khobar; Remote; SAR 150,000 - 200,000; Full time

Job summary

A global technology firm is seeking an experienced Data Engineer to design and maintain data pipelines crucial for analytics in the oil and gas sector. The ideal candidate will have a strong background in Spark, Kafka, and both SQL and NoSQL databases, alongside knowledge of industry standards. This remote role offers an opportunity to work with cross-functional teams while ensuring data integrity and compliance.

Qualifications

• Proven experience with big data tools (Spark, Kafka) and ETL development.
• Strong proficiency in SQL and NoSQL databases.
• Experience with time-series databases (InfluxDB, TimescaleDB) preferred.
• Knowledge of oil & gas data standards (OSIsoft PI, P&IDs) is highly valued.

Responsibilities

• Design, develop, and maintain robust data pipelines using Spark and Kafka for real-time processing.
• Manage SQL and NoSQL databases to ensure data quality and accessibility.
• Collaborate with teams to deliver reliable data solutions.

Skills

Spark

Kafka

SQL

NoSQL

InfluxDB

TimescaleDB

Data integration

Data quality

Education

Bachelor’s degree in Computer Science, Engineering, or related field

Job description

Job Summary

We are looking for an experienced Data Engineer proficient in designing, building, and maintaining scalable data pipelines and ETL processes. The ideal candidate has expertise in Spark, Kafka, SQL/NoSQL databases, and time-series databases like InfluxDB and TimescaleDB. Familiarity with oil & gas data standards such as OSIsoft PI and P&IDs is a significant advantage. This off-site role will support data engineering needs enabling efficient data integration and analytics in the oil and gas sector.

Key Responsibilities

• Design, develop, and maintain robust data pipelines using Spark and Kafka for real-time and batch data processing.
• Build and optimize ETL workflows and data integration processes to support business analytics and operational reporting.
• Manage SQL and NoSQL databases to ensure data quality, accessibility, and performance.
• Work with time-series databases such as InfluxDB and TimescaleDB for handling sensor and industrial data.
• Ensure data compliance with oil and gas industry standards, including handling data formats like OSIsoft PI and P&IDs.
• Collaborate with data scientists, analysts, and engineering teams to deliver reliable and scalable data solutions.
• Develop automation scripts and monitoring to maintain data pipeline health and reliability.
• Document data architecture, pipelines, and work processes for consistency and knowledge sharing.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field.
• Proven experience with big data tools (Spark, Kafka) and ETL development.
• Strong proficiency in SQL and NoSQL databases.
• Experience with time-series databases (InfluxDB, TimescaleDB) preferred.
• Knowledge of oil & gas data standards (OSIsoft PI, P&IDs) is highly valued.
• Familiarity with cloud platforms and containerized environments is a plus.
• Strong problem-solving skills and ability to work remotely with cross-functional teams.

Preferred Skills

• Experience in oil & gas or industrial sector data engineering.
• Knowledge of data governance and compliance in industrial environments.
• Proficiency in Python or other scripting languages for automation.