Databricks Data Engineer — Lakehouse & Modeling

Winsupply; Moraine (OH); On-site; USD 120,000 - 170,000; Full time

Job summary

Winsupply is seeking a Senior Data Engineer - Databricks & Data Modeling to build and maintain production data pipelines in a Databricks lakehouse on Google Cloud. You will design relational and dimensional models, ingest diverse data sources, and deliver Silver- and Gold-layer data products for business use.

You will collaborate with Data Governance, IT, and stakeholders, ensuring scalable, reliable data delivery and cost-aware performance across the data platform.

Qualifications

• 7+ years of related professional experience in data engineering, data warehousing, analytics engineering, or comparable roles.
• 3+ years of hands-on Databricks production experience with Delta Lake, Unity Catalog, Spark/PySpark, and Databricks SQL.
• 3+ years of meaningful relational or dimensional data modeling experience, including personally designing and deploying fact/dimension or integrated business models.
• Foundational understanding of core business processes and entities (e.g., Customer, Product, Vendor, Purchasing, Inventory, Sales, and Pricing).
• Experience building production ETL/ELT pipelines, implementing incremental processing, and supporting operational data quality and monitoring.
• Strong SQL and Python/PySpark skills, with hands-on Git, testing, code review, and CI/CD practices.

Responsibilities

• Build, test, deploy, and support production ingestion and transformation pipelines using Databricks, Delta Lake, Unity Catalog, Apache Spark, Python/PySpark, and Databricks SQL.
• Independently design and implement relational and dimensional data models for assigned data products, including fact tables, conformed dimensions, star schemas, and slowly changing dimensions (SCD Type 1/2).
• Translate core business processes and relationships among Customer, Product, Vendor, Purchasing, Inventory, Sales, and Pricing entities into Silver-layer structures and Gold-layer data products.
• Ingest and integrate batch and streaming data from ERP, relational, legacy/mainframe, fixed-width or delimited files, APIs, and cloud storage; handle schema changes, incremental loads, and CDC.
• Implement business keys, table grain, joins, deduplication, history handling, and source-to-target mappings; ensure repeatable, traceable results.
• Create and automate data quality checks, reconciliation, pipeline monitoring, alerting, exception handling, and recovery procedures for production operations.
• Tune Spark workloads, Databricks SQL queries, Delta table layouts, job configuration, and compute usage to improve performance and cost efficiency.
• Develop reusable, maintainable code with Git, peer reviews, unit/integration tests, CI/CD, and repeatable Databricks deployment practices.
• Collaborate with Data Governance to validate definitions and business rules and inform data modeling decisions.
• Document pipelines, models, transformation logic, dependencies, and runbooks for maintenance by the broader team.
• Troubleshoot data defects and pipeline failures, identify root causes, and drive fixes through production with communication and ownership.

Skills

SQL

Python/PySpark

Databricks

Delta Lake

Data Modeling

Git/CI/CD

Communication

Education

Associate degree in Computer Science / related field

Bachelor's degree in Computer Science / Information Systems / Data Engineering or related

Tools

Google Cloud

Databricks on Google Cloud

Delta Lake

Spark/PySpark

Looker/BI tools

Job description

Winsupply is seeking a Senior Data Engineer - Databricks & Data Modeling to build and maintain production data pipelines in a Databricks lakehouse on Google Cloud. You will design relational and dimensional models, ingest diverse data sources, and deliver Silver- and Gold-layer data products for business use.

You will collaborate with Data Governance, IT, and stakeholders, ensuring scalable, reliable data delivery and cost-aware performance across the data platform.