Lead Databricks & Azure Data Platform Engineer

Kestra Financial; Tempe (AZ); On-site; USD 120,000 - 150,000; Full time

Benefits offered by this job

Competitive pay and benefits

401(k) and health insurance

Opportunities for training and development

Tuition reimbursement

Job summary

A leading financial services firm based in Tempe, Arizona, is looking for a seasoned Databricks Data Engineer. The role requires designing and optimizing scalable data pipelines using Databricks and Azure. Candidates should have 8+ years of experience in data engineering with strong skills in SQL, Python, and ETL frameworks. The position offers competitive pay and benefits, including 401(k) and health insurance, as well as opportunities for professional development and career growth.

Qualifications

• 8+ years of experience designing and developing scalable data pipelines.
• Expertise in data engineering and data warehousing with enterprise-grade solutions.
• Proven ability to lead data initiatives in cross-functional organizations.

Responsibilities

• Design, build, and optimize large-scale data pipelines on Databricks.
• Modernize the Azure-based data ecosystem.
• Utilize Apache Airflow for orchestration and workflow automation.
• Develop and optimize ETL/ELT pipelines using Python and PySpark.

Skills

SQL

Python

PySpark

ETL/ELT frameworks

Data governance

Apache Airflow

Tools

Databricks

Azure

Snowflake

Job description

A leading financial services firm based in Tempe, Arizona, is looking for a seasoned Databricks Data Engineer. The role requires designing and optimizing scalable data pipelines using Databricks and Azure. Candidates should have 8+ years of experience in data engineering with strong skills in SQL, Python, and ETL frameworks. The position offers competitive pay and benefits, including 401(k) and health insurance, as well as opportunities for professional development and career growth.