Databricks Data Engineer

Henderson Scott; Irving (TX); On-site; USD 100,000 - 130,000; Full time

Job summary

Henderson Scott located in Irving, TX is seeking a Databricks Data Engineer to join their data and analytics team. This role will focus on building and optimizing scalable data platforms using Databricks and PySpark in a cloud environment.

The ideal candidate will have strong hands-on experience with data engineering, data pipelines, and a solid background in tools like Delta Lake. The role offers the opportunity to work collaboratively with Data Scientists and Analysts.

Qualifications

• Strong hands-on experience with Databricks, PySpark, and cloud-based data engineering.
• Expertise in building scalable ETL pipelines and data transformation frameworks.
• Knowledge of data governance, security, and access controls.

Responsibilities

• Design, build, and maintain ETL/ELT pipelines using Databricks and PySpark.
• Develop batch and streaming data solutions using the Medallion Architecture.
• Optimize Spark workloads and Databricks environments for performance.

Skills

Databricks Data Intelligence Platform

PySpark

SQL

Python development

Data warehousing

Education

Databricks Certification (Associate or Professional level preferred)

Tools

Delta Lake

Git

Airflow

Job description

Location: Irving, TX

Experience needed: Strong hands-on experience with Databricks, PySpark, and cloud-based data engineering, including building scalable ETL pipelines, data transformation frameworks, and large-scale data processing solutions.

About the Role

We're looking for a Databricks Data Engineer to join a large-scale data and analytics team, helping to design, build, and optimize modern data platforms within a cloud environment.

This is a hands‑on engineering role focused on Databricks, PySpark, Delta Lake, and cloud‑native data solutions. You'll work closely with Data Scientists, Analysts, and Engineering teams to deliver scalable, secure, and high‑performing data pipelines.

Key Responsibilities

• Design, build, and maintain ETL/ELT pipelines using Databricks and PySpark
• Develop batch and streaming data solutions using the Medallion Architecture
• Implement data governance, security, and access controls using Unity Catalog
• Optimize Spark workloads and Databricks environments for performance and cost efficiency
• Support Data Scientists and Analytics teams with curated datasets and reporting solutions
• Participate in code reviews, troubleshooting, and continuous improvement initiatives
• Create and maintain technical documentation for data pipelines and processes

What we need from you

• Strong hands‑on experience with the Databricks Data Intelligence Platform
• Databricks Certification (Associate or Professional level preferred)
• Expertise in PySpark and Python development
• Strong SQL skills and experience with large-scale data processing
• Experience with Delta Lake, Unity Catalog, Auto Loader, Databricks Workflows, and MLflow
• Experience working with Databricks on AWS, Azure, or GCP
• Knowledge of data warehousing, ETL/ELT, distributed computing, and data modelling principles
• Experience with Apache Iceberg would be highly beneficial
• Exposure to CI/CD, Git, Airflow, or similar data engineering tooling is advantageous