Senior Databricks Data Engineer - Cloud Platform Specialist

The Heritage Group

Indianapolis (IN)

On-site

USD 110,000 - 165,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Heritage Construction + Materials in Indianapolis seeks a Senior Data Engineer to design and maintain data pipelines on a cloud data platform, with Databricks and Delta Lake. You will optimize cluster performance, ensure data reliability, and support governance through Unity Catalog.

The role requires 5+ years in data engineering, Python/PySpark, SQL, and cloud experience (Azure preferred); knowledge of Databricks or Snowflake is essential.

Qualifications

Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field.
5+ years of experience in data engineering or a related field.
Experience with Python/PySpark/SQL/Scala.
Hands-on experience with cloud environments (Azure preferred) and Databricks or Snowflake.
Experience with workflow orchestration and CI/CD pipelines.

Responsibilities

Develop and support data pipelines within a Cloud Data Platform (Databricks/Snowflake).
Monitor and optimize Databricks cluster performance for cost-effective scaling.
Automate CI/CD pipelines for data workflows using Azure DevOps.
Integrate Databricks with Azure services (Data Factory, Synapse, ADLS).
Design monitoring solutions and support data governance through Unity Catalog.

Skills

Python/PySpark

SQL

Databricks

Delta Lake

Azure

Azure Data Factory

Azure Synapse

ADLS

Data governance

Education

Bachelor’s or Master’s in CS/Engineering/Data Science

Tools

Databricks

Snowflake

Azure DevOps

Azure Data Factory

Azure Synapse

ADLS

Job description

The role requires 5+ years in data engineering, Python/PySpark, SQL, and cloud experience (Azure preferred); knowledge of Databricks or Snowflake is essential.

Get your free, confidential resume review.

or drag and drop your file here.