Data Engineer: Databricks Lakehouse Pipelines (Hybrid)

CosmoProf Beauty; Denton (TX); Hybrid; USD 95,000 - 140,000; Full time

Benefits offered by this job

Medical, dental, vision

401(k) with company match

Merchandise discount

Job summary

Sally Beauty Holdings, Inc. in Plano, Texas, is seeking a Data Engineer to design and maintain data pipelines on the Databricks Lakehouse Platform.

You will collaborate with Data Engineers, Architects, and business stakeholders to enable reporting, analytics, AI, and ML initiatives. The role requires a Bachelor’s degree in a technical field, 3+ years in data/software engineering, and hands-on Databricks experience.

Qualifications

• Bachelor’s degree or technical field required.
• 3+ years of Data Engineering or Software Engineering experience.
• 1+ years with the Databricks Lakehouse Platform.
• Experience with ADLS/S3 or similar cloud storage.
• Experience with Azure/AWS/GCP cloud platforms.
• Experience supporting Power BI or similar BI platforms.
• Retail, merchandising, supply chain, or ecommerce experience preferred.

Responsibilities

• Design, develop, and maintain scalable data pipelines on Databricks Lakehouse Platform.
• Build ETL/ELT processes using Spark, PySpark, Spark SQL, Delta Lake.
• Develop batch and streaming data ingestion pipelines from enterprise systems and cloud platforms.
• Create reusable data transformation frameworks with PySpark and SQL.
• Optimize Spark jobs and Delta Lake tables for performance and cost efficiency.
• Configure Unity Catalog for data governance and lineage.
• Build workflows with Databricks Workflows and Jobs.
• Support CDC and incremental data processing.
• Create semantic data models for reporting, AI, and ML.

Skills

Databricks Lakehouse

Delta Lake (DLT)

Unity Catalog

Medallion Architecture

ETL/ELT Pipelines

Data Modeling

SQL Development

Python Programming

REST API Integration

Cloud Platforms

BI & Analytics

Analytical Thinking

Communication

Collaboration

Project Planning

Education

Bachelor’s degree in Computer Science / Information Systems / Software Engineering

Tools

Databricks Lakehouse Platform

Azure Data Lake Storage

Power BI

Spark / PySpark

Job description

Sally Beauty Holdings, Inc. in Plano, Texas, is seeking a Data Engineer to design and maintain data pipelines on the Databricks Lakehouse Platform.

You will collaborate with Data Engineers, Architects, and business stakeholders to enable reporting, analytics, AI, and ML initiatives. The role requires a Bachelor’s degree in a technical field, 3+ years in data/software engineering, and hands-on Databricks experience.