Hybrid Data Engineer — Databricks Lakehouse Expert

DataJobs; Denton (TX); Hybrid; USD 100,000 - 140,000; Full time

Benefits offered by this job

Medical Insurance

Dental Insurance

Paid Vacation

Tuition Reimbursement

401(k) with Company Match

Job summary

Sally Beauty Supply LLC in Plano, TX is seeking a seasoned Data Engineer to design, build, and maintain scalable data pipelines on the Databricks Lakehouse Platform. You will shape ingestion, transformation patterns, and governance practices to support reporting, analytics, AI, and ML initiatives.

The role emphasizes hands-on PySpark, Spark SQL, Delta Lake, and orchestration with Databricks Workflows and Jobs, plus collaboration with stakeholders across the business.

Qualifications

• Bachelor’s degree in computer science, information systems, software engineering, data engineering, or related technical field.
• 3+ years of experience in data engineering or software engineering.
• 1+ years hands-on with the Databricks Lakehouse Platform.
• Experience with cloud storage (ADLS, S3) and at least one cloud provider (Azure/AWS/GCP).
• Experience supporting enterprise analytics platforms.

Responsibilities

• Design, develop, and maintain scalable data pipelines on the Databricks Lakehouse Platform.
• Build ETL/ELT processes using Spark, PySpark, Spark SQL, and Delta Lake.
• Design and implement Medallion Architecture (Bronze, Silver, Gold).
• Develop batch and streaming ingestion from enterprise systems and cloud platforms.
• Create reusable transformation frameworks with PySpark and SQL.
• Optimize Spark jobs and Delta Lake tables for performance and cost.
• Configure Unity Catalog for data governance, security, and lineage.
• Develop workflows with Databricks Workflows and Jobs.
• Support CDC and incremental data processing.
• Build semantic data models for reporting, analytics, AI, and ML.
• Implement automated testing, monitoring, and alerting; document standards.

Skills

Databricks Lakehouse Platform

ETL/ELT

Spark

PySpark

Spark SQL

Delta Lake

Medallion Architecture

SQL

Python

Data governance

Databricks Workflows

Databricks Jobs

CDC

Education

Bachelor’s degree in computer science, Information Systems, Software Engineering, Data Engineering, or related field

Tools

Azure Data Lake Storage

Amazon S3

Microsoft Azure

AWS

Google Cloud Platform

Job description

Sally Beauty Supply LLC in Plano, TX is seeking a seasoned Data Engineer to design, build, and maintain scalable data pipelines on the Databricks Lakehouse Platform. You will shape ingestion, transformation patterns, and governance practices to support reporting, analytics, AI, and ML initiatives.

The role emphasizes hands-on PySpark, Spark SQL, Delta Lake, and orchestration with Databricks Workflows and Jobs, plus collaboration with stakeholders across the business.