Principal Data Engineer

Primary Services; Houston (TX); On-site; USD 170,000 - 230,000; Full time

Job summary

Primary Services, a global energy leader, seeks a Principal Data Engineer to build data foundations and end-to-end solutions for a new freight technology platform. You will define data architecture and strategy while delivering data ingestion, integration, hosting, and distribution across systems.

You will influence standards, mentor the data engineering community, and partner with tech and business leaders to advance data-driven decision-making.

Qualifications

• Expert-level AWS, Azure and/or SAP with deep tech experience.
• Expert-level ELT, data modeling, data integration and ingestion.
• Hands-on design and delivery of enterprise-scale data platforms.
• Experience with large-scale data processing and data manipulation.
• Proficient with Data Factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis and Redshift.
• Familiar with GitHub Actions, Azure DevOps, SonarQube and PyTest.
• Ability to communicate data concepts to technical and business leaders.
• Experience leading technical communities and setting data engineering standards.

Responsibilities

• Design scalable data foundations, platforms, and end-to-end data solutions.
• Define data architecture and strategy for a new freight and voyage platform.
• Develop data solutions that ingest, integrate, process, host, and distribute data.
• Lead delivery across cloud and enterprise tech including Azure, AWS, SAP.
• Mentor data engineers and promote engineering standards and best practices.
• Drive knowledge sharing through communities of practice and training.

Skills

AWS

Azure

SAP

ELT

Data modeling

Data integration

Data ingestion

Data pipelines

Data processing

Data Factory

Databricks

SQL

Synapse

Stream Analytics

Glue

Airflow

Kinesis

Redshift

GitHub Actions

Azure DevOps

SonarQube

PyTest

Tools

Data Factory

Databricks

SQL DB

Synapse

Stream Analytics

Glue

Airflow

Kinesis

Redshift

GitHub Actions

Azure DevOps

SonarQube

PyTest

Job description

Join one of the world’s largest integrated energy companies, with 85,000 employees across more than 70 countries helping provide energy directly or indirectly to approximately 1 billion people each year. With a global portfolio spanning oil and gas, LNG, fuels, lubricants, chemicals, electric vehicle charging, and lower‑carbon energy solutions, the organization offers opportunities to contribute to large‑scale projects while building a career in a culture focused on innovation, safety, collaboration, and operational excellence.

The Principal Data Engineer will serve as a hands‑on technical leader responsible for designing future‑ready data foundations and end‑to‑end solutions for a major new freight technology platform. This role will define data architecture and strategy while developing solutions that ingest, integrate, host, and distribute data across multiple systems. As a subject matter expert, the Principal Data Engineer will also influence engineering standards, mentor the broader data engineering community, and partner with technical and business leaders to advance data‑driven decision‑making.

Responsibilities

• Design scalable data foundations, platforms, and end‑to‑end data engineering solutions.
• Define data architecture and strategy supporting a new enterprise freight and voyage management platform.
• Develop data solutions that ingest, integrate, process, host, and distribute information across multiple integration points.
• Design data models and master data processes supporting freight operations and business reporting.
• Lead technical delivery across cloud and enterprise technologies including Azure, AWS, and SAP.
• Develop and optimize ELT pipelines, data integration frameworks, and ingestion processes.
• Evaluate middleware and integration solutions connecting enterprise systems with external voyage management technology.
• Partner with business and technology stakeholders to translate complex requirements into scalable technical solutions.
• Establish engineering standards and drive improvements in implementation speed, quality, cost, and value delivery.
• Support change, incident, and problem management processes.
• Lead knowledge‑sharing initiatives through technical communities, presentations, training, Centers of Excellence, and Communities of Practice.

Qualifications

• Expert‑level experience with AWS, Azure, and/or SAP, with deep expertise across multiple core technologies.
• Expert‑level knowledge of ELT, data modeling, data integration, and data ingestion.
• Hands‑on experience designing and delivering enterprise‑scale data platforms and architectures.
• Experience with data manipulation and large‑scale data processing.
• Proficiency with technologies such as Data Factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, and Redshift.
• Experience with GitHub, GitHub Actions, Azure DevOps, SonarQube, and PyTest.
• Experience integrating data across complex enterprise applications and external technology ecosystems.
• Ability to communicate data architecture and engineering concepts to both technical teams and business leadership.
• Experience leading technical communities and establishing data engineering standards and best practices.
• Project management, Scrum leadership, BPC/Planning, team leadership, or MKDocs experience is a plus.