Senior Data Engineer: Databricks on Azure Data Platform

Independence Pet Holdings; Kentucky; On-site; USD 110,000 - 150,000; Full time

Benefits offered by this job

Healthcare

Dental Insurance

Vision Insurance

Parental Leave

Retirement Savings Plan

Paid Time Off

Job summary

Independence Pet Holdings is seeking a Senior Data Engineer to design, build, and optimize robust data pipelines across a medallion architecture. You will ensure data accuracy, govern data quality, and drive scalable data models for multiple product teams.

The role requires 7+ years of experience with ELT/ETL, Databricks, Spark, and Azure data services, plus strong Python and SQL skills. Collaboration with the data team and cloud security practices are essential.

Qualifications

• Bachelor’s degree in CS/IT or related field.
• 7+ years building data pipelines (ELT/ETL).
• Experience with Databricks, Spark, and Azure data services.

Responsibilities

• Design, develop, and deploy scalable data pipelines using Databricks.
• Optimize pipeline performance for efficiency and cost.
• Model data in lake environments for multiple use cases.
• Implement data quality controls and governance practices.
• Integrate Databricks with Azure storage and security services.

Skills

Python

SQL

Analytical thinking

Problem solving

Data modeling

Education

Bachelor’s degree in computer science or related field

Tools

Databricks

Spark

Azure Data Services

Azure DevOps

GitLab

CI/CD pipelines

JSON/Parquet/ORC

Job description

Independence Pet Holdings is seeking a Senior Data Engineer to design, build, and optimize robust data pipelines across a medallion architecture. You will ensure data accuracy, govern data quality, and drive scalable data models for multiple product teams.

The role requires 7+ years of experience with ELT/ETL, Databricks, Spark, and Azure data services, plus strong Python and SQL skills. Collaboration with the data team and cloud security practices are essential.