Senior Data Engineer: Lakehouse, Pipelines & Analytics

Camden Copper/Metis Endeavor; Camden (SC); On-site; USD 120,000 - 160,000; Full time

Job summary

Camden Copper/Metis Endeavor is hiring a Senior Data Engineer to build and scale our Databricks lakehouse, turning fragmented data into reliable assets that empower analytics, AI, and decision-making across global operations.

You will architect batch and near-real-time pipelines, curate data from ERP and external feeds, and partner with business owners to define KPIs in a unified semantic layer, ensuring security, lineage, and governance for government contracts.

Qualifications

• 4+ years of professional data engineering experience building production pipelines.
• Strong SQL and Python; experience with Spark or a comparable distributed engine.
• Hands-on experience with a lakehouse or cloud warehouse (Databricks preferred; Snowflake or BigQuery considered).
• Experience with dbt or a comparable transformation and testing framework.
• Experience with Git-based workflows, CI, and orchestration (Databricks Workflows, Airflow, or similar).
• Comfort working directly with non-technical business owners to define metrics and resolve data issues.
• Ability to work as a U.S. person and support government contract data requirements.

Responsibilities

• Architect, build, and maintain batch and near-real-time ELT/ETL pipelines that are scalable, reliable, and maintainable.
• Ingest and curate data from disparate systems including ERP systems and external feeds.
• Design, build, and maintain central data models in dbt to support analytics, data science, optimization, and AI workflows.
• Partner with business owners to define and standardize KPIs in a unified semantic layer.
• Perform QA checks against source systems and reconcile discrepancies with data owners.
• Implement data quality validation, monitoring, and alerting for downstream trust.
• Collaborate with ML and platform engineers on model training, scoring, and deployment.

Skills

SQL

Python

Spark

Tools

Databricks

dbt

Git-based workflows

Airflow

Databricks Workflows

Job description

Camden Copper/Metis Endeavor is hiring a Senior Data Engineer to build and scale our Databricks lakehouse, turning fragmented data into reliable assets that empower analytics, AI, and decision-making across global operations.

You will architect batch and near-real-time pipelines, curate data from ERP and external feeds, and partner with business owners to define KPIs in a unified semantic layer, ensuring security, lineage, and governance for government contracts.