Senior Data Platform Engineer – Databricks & SAP

D&H Distributing; Harrisburg (Dauphin County); Hybrid; USD 140,000 - 170,000; Full time

Benefits offered by this job

ESOP

401k

Health benefits

Gym reimbursement

WFH reimbursement

Tuition assistance

Job summary

D&H Distributing, a 100+ year old employee-owned technology distributor, seeks a Sr. Data Engineer – Data Platform to help build a next‑generation data platform spanning SAP, Databricks, and cloud sources.

The Senior Data Engineer will design, build, and operate scalable data pipelines, collaborate with cross‑functional teams, and drive lakehouse patterns while migrating legacy workloads to modern architectures.

Qualifications

• 8+ years of progressive experience in data engineering, data integration, ETL/ELT, or enterprise data platform development.
• Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or a related field; or an equivalent combination of education, training, and relevant professional experience.
• Strong hands-on experience with either modern Databricks/Spark data engineering or SAP enterprise data engineering, with the ability to contribute across integrated data environments.
• Advanced SQL skills and strong knowledge of data modeling and scalable data-transformation patterns.
• Experience building and supporting production-grade data pipelines, including orchestration, monitoring, data quality, error handling, recovery, and performance optimization.
• Experience working with cloud or distributed data architectures.
• Ability to translate business and technical requirements into scalable, maintainable data solutions.
• Strong problem-solving, collaboration, documentation, and communication skills across technical and business teams.
• Ability to work effectively in a modernization environment where technologies, standards, and operating practices continue to evolve.

Responsibilities

• Design, develop, test, deploy, and support scalable data pipelines across SAP, Databricks, and related cloud and enterprise environments.
• Develop production-grade ingestion and transformation workloads using SQL and appropriate distributed data-processing technologies.
• Apply reusable engineering patterns for orchestration, data quality, observability, monitoring, error handling, and recovery.
• Collaborate with SAP, Data Platform, Infrastructure, Security, Architecture, Analytics, and business teams to deliver reliable end-to‑end data solutions.
• Contribute to lakehouse and medallion architecture patterns and the development of governed, reusable data products.
• Optimize data workloads for performance, scalability, reliability, maintainability, and cost efficiency.
• Follow engineering practices for source control, automated testing, CI/CD, deployment, documentation, and environment promotion.
• Support migration from legacy EDW/ETL platforms to modern cloud-based architectures while validating completeness and data integrity.
• Deliver trusted and certified datasets for enterprise reporting, analytics, planning, and AI use cases.
• Participate in design reviews, troubleshooting production support, knowledge transfer, and continuous improvement of team standards.
• Develop broader proficiency across D&H’s integrated SAP and Databricks platform through applied project work, mentoring, and training.

Skills

Databricks/Spark

SQL

Data modeling

Cloud data architectures

ETL/ELT

Education

Bachelor’s degree in Computer Science or related field

Tools

Databricks

SAP Data

Delta Lake

Power BI

Job description

D&H Distributing, a 100+ year old employee-owned technology distributor, seeks a Sr. Data Engineer – Data Platform to help build a next‑generation data platform spanning SAP, Databricks, and cloud sources.

The Senior Data Engineer will design, build, and operate scalable data pipelines, collaborate with cross‑functional teams, and drive lakehouse patterns while migrating legacy workloads to modern architectures.