Data Engineer/Architect Oil and Gas (Outside IR35)

ZipRecruiter; London; Hybrid; GBP 50,000 - 80,000; Full time

Job summary

A leading company in the oil and gas sector is seeking a Data Engineer to manage and optimise their Data Warehouse. This role involves integrating data from key industry systems to support critical analytics and reporting functions, ensuring data integrity and availability for business operations.

Qualifications

• Proven experience as a Data Engineer or ETL Developer.
• Advanced SQL skills and expertise in relational database management.
• Hands-on experience with specific upstream oil and gas systems.

Responsibilities

• Manage and optimise the organisation’s Data Warehouse.
• Define and enforce governance standards for data consistency.
• Collaborate with stakeholders to deliver actionable insights.

Skills

SQL

Data Integration

Data Quality Assurance

Troubleshooting

Education

Degree in a relevant field (e.g., Computer Science, Data Engineering)

Tools

Power BI

SAP

Energy Components

PI ProcessBook

Python

Job description

Job Description

Data Engineer – Oil & Gas (Upstream) Outside IR35

Based Hybrid - London or Aberdeen

Overview

A Data Engineer is sought to support the design, management, and optimisation of a Data Warehouse environment for an organisation operating in the upstream oil and gas sector. The successful candidate will lead data integration from key industry systems such as SAP, Energy Components, and PI Process Book, ensuring the accuracy and availability of data for operational and commercial decision-making. Success in this role means delivering a high-performing, validated data environment tailored to the complexities of upstream operations. The role supports business-critical analytics and reporting across technical, commercial, and operational teams.

Key Responsibilities

Data Warehouse Management

• Own and maintain the organisation’s Data Warehouse as a single source of truth.
• Monitor and optimise warehouse performance, scalability, and resilience.
• Develop and implement robust data quality controls, including cleansing and validation processes.

Data Quality & Governance

• Define and enforce governance standards for data consistency, security, and regulatory compliance.
• Maintain detailed audit trails and documentation for all data transformations.
• Identify opportunities for automation and process improvement across the data lifecycle.

Data Integration & Pipeline Management

• Manage data pipelines from upstream oil and gas systems, including SAP, Energy Components, and PI Process Book.
• Ensure seamless ingestion, transformation, and storage of data in support of field operations, production reporting, and commercial analysis.
• Troubleshoot data flow issues and work with IT and business teams to onboard new data sources as needed.

Reporting & Business Intelligence

• Collaborate with engineers, commercial analysts, and other stakeholders to deliver actionable reporting and insights.
• Support dashboard development and reporting structures using tools like Power BI, ensuring alignment with upstream KPIs and operational workflows.
• Act as a key technical resource for business intelligence tools and reporting optimisation.

Required Experience & Qualifications

• Proven experience as a Data Engineer or ETL Developer, ideally within the upstream oil and gas industry.
• Advanced SQL skills and expertise in relational database and data warehouse management.
• Hands-on experience with SAP, Energy Components, PI ProcessBook, or similar upstream systems.
• Strong knowledge of data quality assurance, cleansing, and validation techniques.
• Proficiency with Power BI or comparable reporting/visualisation platforms.

Qualifications

• Background in oil and gas data domains, including production, metering, hydrocarbon accounting, or commercial reporting.
• Experience with Python, R, or similar scripting for data manipulation and automation.
• Familiarity with data governance standards and compliance frameworks (e.g., GDPR, ISO 27001).

Key Skills & Attributes

• Strong troubleshooting skills with experience resolving upstream data flow issues.
• Expertise in ETL/ELT development and data integration specific to oil and gas environments.
• High attention to detail, especially around data integrity and auditability.
• Collaborative approach with technical and business stakeholders.
• Proactive, adaptable, and capable of operating in a fast-paced, asset-focused environment.