Data Engineer

eNGINE; Pennsylvania; On-site; USD 120,000 - 180,000; Full time

Job summary

eNGINE is hiring multiple Senior Data Engineers to own and evolve our enterprise data warehouse on Databricks. You will design pipelines from raw ingestion through clean, trusted tables and support analytics with Gold-layer data.

You will own data models, enforce conformance, and build event-driven architecture while documenting the platform so no single memory is required. Collaboration with stakeholders is essential in this role in a fast-paced environment.

Qualifications

• Hands-on data engineering with ownership of a warehouse or large-scale pipelines and SLAs.
• Deep experience with Databricks: Delta Lake, medallion architecture, Unity Catalog.
• Strong data modeling background focused on conformance and harmonization.
• Advanced SQL plus PySpark and Python skills.
• Experience with Azure data stack: Data Factory, Data Lake Storage, and Azure DevOps for CI/CD.
• Ability to walk into a complex, loosely documented system and make sense of it.
• Comfortable communicating with both technical and business stakeholders.

Responsibilities

• Design and build pipelines across Bronze, Silver, and Gold layers.
• Write transformation and harmonization logic for usable data.
• Build Gold-layer tables that feed reporting and analytics.
• Spend time on documentation to ensure platform knowledge isn't siloed.

Skills

Databricks

Delta Lake

Medallion architecture

Unity Catalog

SQL

PySpark

Python

Azure Data Factory

Data Lake Storage

Azure DevOps

CI/CD

Stakeholder comms

Tools

Event Hubs

Kafka

Job description

eNGINE builds Technical Teams. We are a Solutions and Placement firm shaped by decades of interaction with Technical professionals. Our inspiration is continuous learning and engagement with the markets we serve, the talent we represent, and the teams we build. Our Consulting Workforce is encouraged to enjoy career fulfillment in the form of challenging projects, schedule flexibility, and paid training/certifications. Successful outcomes start and finish with eNGINE.

eNGINE is hiring multiple Senior Data Engineers to help own and evolve our enterprise data warehouse. You'll be responsible for how data moves through our Databricks platform — from raw ingestion all the way through to the clean, trusted tables the business relies on every day.

This isn't a role where you're handed a ticket and told what to build. You'll own specific domains within the warehouse outright — the data models, the pipeline reliability, the quality checks that keep everything trustworthy. You'll also help build out the automation and event-driven architecture that moves us away from older, slower batch patterns.

Day to day, you'll design and build pipelines across our Bronze, Silver, and Gold layers, write the transformation and harmonization logic that turns raw data into something usable, and build out the Gold-layer tables that feed our reporting and analytics work. You'll also spend real time on documentation — not as an afterthought, but because we don't want any part of this platform to depend on one person's memory.

What we're looking for:

• Several years of hands-on data engineering experience, including real ownership of a warehouse or large-scale pipelines with actual SLAs to hit
• Deep, practical experience with Databricks — Delta Lake, medallion architecture, Unity Catalog
• Strong data modeling background, especially conformance and harmonization logic
• Advanced SQL along with solid PySpark and Python skills
• Experience with Azure's data stack — Data Factory, Data Lake Storage, and Azure DevOps for CI/CD
• Ability to walk into a complex, loosely documented system and make sense of it
• Comfortable communicating directly with technical and business stakeholders alike

Nice to have:

• Background in healthcare, specialty pharmacy, or another regulated industry
• Experience with event-driven ingestion tools like Event Hubs or Kafka
• Familiarity with data contract standards or observability platforms like Monte Carlo
• Exposure to enterprise data catalog tools such as Atlan or Collibra
• A track record of mentoring engineers and setting technical standards without needing a formal title to back it up

Next Steps:

No C2C, relocation, referral, or sponsorship candidates for this role.