Lead Data Platform Engineer & Architecture Leader

Primary Services; Houston (TX); On-site; USD 170,000 - 230,000; Full time

Job summary

Primary Services, a global energy leader, seeks a Principal Data Engineer to build data foundations and end-to-end solutions for a new freight technology platform. You will define data architecture and strategy while delivering data ingestion, integration, hosting, and distribution across systems.

You will influence standards, mentor the data engineering community, and partner with tech and business leaders to advance data-driven decision-making.

Qualifications

• Expert-level AWS, Azure and/or SAP with deep tech experience.
• Expert-level ELT, data modeling, data integration and ingestion.
• Hands-on design and delivery of enterprise-scale data platforms.
• Experience with large-scale data processing and data manipulation.
• Proficient with Data Factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis and Redshift.
• Familiar with GitHub Actions, Azure DevOps, SonarQube and PyTest.
• Ability to communicate data concepts to technical and business leaders.
• Experience leading technical communities and setting data engineering standards.

Responsibilities

• Design scalable data foundations, platforms, and end-to-end data solutions.
• Define data architecture and strategy for a new freight and voyage platform.
• Develop data solutions that ingest, integrate, process, host, and distribute data.
• Lead delivery across cloud and enterprise tech including Azure, AWS, SAP.
• Mentor data engineers and promote engineering standards and best practices.
• Drive knowledge sharing through communities of practice and training.

Skills

AWS

Azure

SAP

ELT

Data modeling

Data integration

Data ingestion

Data pipelines

Data processing

Data Factory

Databricks

SQL

Synapse

Stream Analytics

Glue

Airflow

Kinesis

Redshift

GitHub Actions

Azure DevOps

SonarQube

PyTest

Tools

Data Factory

Databricks

SQL DB

Synapse

Stream Analytics

Glue

Airflow

Kinesis

Redshift

GitHub Actions

Azure DevOps

SonarQube

PyTest

Job description

Primary Services, a global energy leader, seeks a Principal Data Engineer to build data foundations and end-to-end solutions for a new freight technology platform. You will define data architecture and strategy while delivering data ingestion, integration, hosting, and distribution across systems.

You will influence standards, mentor the data engineering community, and partner with tech and business leaders to advance data-driven decision-making.