Senior Databricks & Azure Data Platform Engineer

Kestra Holdings

Tempe (AZ)

Presencial

USD 120 000 - 150 000

Tempo integral

14 dias+

Uma candidatura completa num minuto

Currículo e carta de apresentação personalizados, prontos a enviar.

Ultrapassa os filtros ATS

Vantagens oferecidas por esta oferta de emprego

Competitive pay and benefits
401(k) and health insurance
Opportunities for training and development

Resumo da oferta

A leading wealth management firm in Tempe, Arizona is seeking a seasoned Databricks Data Engineer to design and optimize data pipelines on the Databricks Lakehouse platform. The role demands expertise in Azure cloud services, SQL, Python, and ETL/ELT frameworks to modernize data ecosystems. Candidates should have over 8 years of experience in data engineering, a strong background in compliance practices, and the ability to work with financial datasets. This position offers competitive benefits and a collaborative work environment.

Qualificações

  • 8+ years of experience in data engineering and data warehousing.
  • Expertise in modern data pipeline development in cloud environments.
  • Proven leadership in coordinated data initiatives across organizations.

Responsabilidades

  • Design and optimize data pipelines on Databricks Lakehouse.
  • Modernize Azure-based data architectures with distributed data engineering.
  • Develop ETL/ELT pipelines using Python and Databricks tools.

Conhecimentos

SQL
Python
Databricks
ETL/ELT frameworks
Azure cloud services
PySpark
Apache Airflow

Ferramentas

Snowflake
Delta Lake
Unity Catalog

Descrição da oferta de emprego

Lead with Purpose. Partner with Impact.

We are seeking a seasoned Databricks Data Engineer with expertise in Azure cloud services and the Databricks Lakehouse platform. The role involves designing and optimizing large-scale data pipelines, modernizing cloud-based data ecosystems, and enabling secure, governed data solutions. Strong skills in SQL, Python, PySpark, ETL/ELT frameworks, and experience with Delta Lake, Unity Catalog, and CI/CD automation are essential.

What you’ll Do:

  • Design, build, and optimize large-scale data pipelines on the Databricks Lakehouse platform, ensuring reliability, scalability, and governance.
  • Modernize the Azure-based data ecosystem, contributing to cloud architecture, distributed data engineering, data modeling, security, and CI/CD automation.
  • Utilize Apache Airflow and similar tools for orchestration and workflow automation.
  • Work with financial or regulated datasets, applying strong compliance and governance practices.
  • Develop and optimize ETL/ELT pipelines using Python, PySpark, Spark SQL, and Databricks notebooks.
  • Design and optimize Delta Lake data models for reliability, performance, and scalability.
  • Implement and manage Unity Catalog for RBAC, lineage, governance, and secure data sharing.
  • Build reusable frameworks using Databricks Workflows, Repos, and Delta Live Tables.
  • Create scalable ingestion pipelines for APIs, databases, files, streaming sources, and MDM systems.
  • Automate API ingestion and workflows using Python and REST APIs.
  • Support data governance, lineage, cataloging, and metadata initiatives.
  • Enable downstream consumption for BI, data science, and application workloads.
  • Write optimized SQL/T-SQL queries, stored procedures, and curated datasets for reporting.
  • Automate deployments, DevOps workflows, testing pipelines, and workspace configuration.

What You Bring:

  • 8+ years of experience designing and developing scalable data pipelines in modern data warehousing environments, with full ownership of end-to-end delivery.
  • Expertise in data engineering and data warehousing, consistently delivering enterprise-grade solutions.
  • Proven ability to lead and coordinate data initiatives across cross-functional and matrixed organizations.
  • Advanced proficiency in SQL, Python, and ETL/ELT frameworks, including performance tuning and optimization.
  • Hands-on experience with Azure, Snowflake, and Databricks, and integration with enterprise systems.
Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Senior Databricks & Azure Data Platform Engineer
Senior Databricks & Azure Data Platform Engineer

Kestra Financial, Inc. • Tempe (AZ)

Presencial
USD 120 000 - 160 000
Competitive pay and benefits
401(k)
Health insurance
+1
Senior Databricks Data Engineer
Senior Databricks Data Engineer

Virtue America • New York (NY)

Presencial
USD 140 000 - 190 000
Databricks Developer
Databricks Developer

Vservice It Solutions • EUA

Teletrabalho
USD 140 000 - 190 000
Azure Data Engineer
Azure Data Engineer

TechDigital Group • Pleasanton (CA)

Presencial
USD 120 000 - 170 000
Azure Data Engineer: Spark, Delta Lake & Pipelines
Azure Data Engineer: Spark, Delta Lake & Pipelines

TechDigital Group • Pleasanton (CA)

Presencial
USD 120 000 - 170 000
Senior Data Engineer
Senior Data Engineer

TechDigital Group • Chicago (IL)

Presencial
USD 120 000 - 150 000
Azure Databricks Data Architect
Azure Databricks Data Architect

Ascendum Solutions • Cincinnati (OH)

Presencial
USD 140 000 - 170 000
Databricks Data Architect
Databricks Data Architect

NewVision Software • EUA

Teletrabalho
USD 120 000 - 180 000
Data Engineer – Azure Databricks
Data Engineer – Azure Databricks

HIGH BRIDGE CONSULTING LLC • New York (NY)

Híbrido
USD 120 000 - 170 000
Senior Databricks Engineer
Senior Databricks Engineer

Remote • San Francisco (CA)

Presencial
USD 150 000 - 190 000