Senior Data Engineer – Lakehouse & ML Pipelines

Principal Mineral Holdings; Camden (SC); On-site; USD 120,000 - 180,000; Full time

Job summary

Principal Mineral Holdings in Camden, SC is seeking a Senior Data Engineer to design and deliver a Databricks lakehouse, robust ELT/ETL pipelines, and trusted data models for KPIs and ML workflows. You’ll work onsite with cross-functional teams to ingest data from ERP systems and external feeds, build central transformation logic with dbt, and ensure governance and security for government contracts.

The role emphasizes data quality, collaboration with ML/platform engineers, and scalable,

Qualifications

• 4+ years of professional data engineering experience building production pipelines.
• Strong SQL and Python; experience with Spark or a comparable distributed engine.
• Hands-on experience with a lakehouse or cloud warehouse (Databricks preferred; Snowflake or BigQuery considered).
• Experience with dbt or a comparable transformation and testing framework.
• Experience with Git-based workflows, CI, and orchestration (Databricks Workflows, Airflow, or similar).
• Comfort working directly with non-technical business owners to define metrics and resolve data issues.
• Ability to work as a U.S. person and support government contract data requirements.

Responsibilities

• Build production ELT/ETL pipelines that are scalable, reliable, and maintainable.
• Ingest data from internal ERP systems and external market, trade, and commodity API feeds.
• Develop central transformation logic using dbt to support analytics, data science, optimization, and ML workflows.
• Standardize operational KPIs in a unified semantic layer (yield, inventory, margins, component SKUs).
• Improve end-to-end lakehouse architecture with cost and scalability optimizations.
• Run QA checks and data quality validation; monitor and alert to ensure trusted data for downstream consumers.
• Collaborate with ML and platform engineers on model training, scoring, and deployment needs.

Skills

SQL

Python

Spark

Tools

Databricks

dbt

Snowflake

BigQuery

Git

Airflow

CI

Databricks Workflows

Unity Catalog

Delta Lake

Job description

Principal Mineral Holdings in Camden, SC is seeking a Senior Data Engineer to design and deliver a Databricks lakehouse, robust ELT/ETL pipelines, and trusted data models for KPIs and ML workflows. You’ll work onsite with cross-functional teams to ingest data from ERP systems and external feeds, build central transformation logic with dbt, and ensure governance and security for government contracts.

The role emphasizes data quality, collaboration with ML/platform engineers, and scalable,