Senior Data Engineer: Databricks & Data Warehouse Lead

eNGINE; Pennsylvania; On-site; USD 120,000 - 180,000; Full time

Job summary

eNGINE is hiring multiple Senior Data Engineers to own and evolve our enterprise data warehouse on Databricks. You will design pipelines from raw ingestion through clean, trusted tables and support analytics with Gold-layer data.

You will own data models, enforce conformance, and build event-driven architecture while documenting the platform so no single memory is required. Collaboration with stakeholders is essential in this role in a fast-paced environment.

Qualifications

• Hands-on data engineering with ownership of a warehouse or large-scale pipelines and SLAs.
• Deep experience with Databricks: Delta Lake, medallion architecture, Unity Catalog.
• Strong data modeling background focused on conformance and harmonization.
• Advanced SQL plus PySpark and Python skills.
• Experience with Azure data stack: Data Factory, Data Lake Storage, and Azure DevOps for CI/CD.
• Ability to walk into a complex, loosely documented system and make sense of it.
• Comfortable communicating with both technical and business stakeholders.

Responsibilities

• Design and build pipelines across Bronze, Silver, and Gold layers.
• Write transformation and harmonization logic for usable data.
• Build Gold-layer tables that feed reporting and analytics.
• Spend time on documentation to ensure platform knowledge isn't siloed.

Skills

Databricks

Delta Lake

Medallion architecture

Unity Catalog

SQL

PySpark

Python

Azure Data Factory

Data Lake Storage

Azure DevOps

CI/CD

Stakeholder comms

Tools

Event Hubs

Kafka

Job description

eNGINE is hiring multiple Senior Data Engineers to own and evolve our enterprise data warehouse on Databricks. You will design pipelines from raw ingestion through clean, trusted tables and support analytics with Gold-layer data.

You will own data models, enforce conformance, and build event-driven architecture while documenting the platform so no single memory is required. Collaboration with stakeholders is essential in this role in a fast-paced environment.