Azure Data Platform Lead (Databricks/Lakehouse)

Aroha Technologies, Inc; Greenfield (IN); On-site; USD 120,000 - 180,000; Full time

Job summary

Aroha Technologies, Inc. in Greenfield, IN is seeking an experienced Data Engineering Tech Lead to design, build, optimize, and maintain scalable Lakehouse solutions on Azure. You will drive batch and near-real-time data processing using Databricks, PySpark, ADF, ADLS Gen2, and Azure SQL.

Lead data pipelines across ERP, API, and relational sources, enforce data governance, and mentor engineers while advancing DevOps practices in the Azure cloud environment.

Qualifications

• 4+ years of experience in Azure Databricks with PySpark.
• 2+ years of experience in Databricks workflow and Unity Catalog.
• 3+ years of experience in ADF (Azure Data Factory).
• 3+ years of experience in ADLS Gen2.
• 3+ years of experience in Azure SQL.
• 5+ years of experience in Azure Cloud platform.
• 2+ years of experience in Python programming and package builds.

Responsibilities

• Lead design, development, and optimization of scalable data pipelines across enterprise sources.
• Ensure high-performance data processing using Databricks, PySpark, and ADF.
• Establish strong data governance, security, and quality across the Lakehouse.
• Provide continuous technical leadership, optimization, and modernization of the data platform.

Skills

Azure Databricks

PySpark

Azure Data Factory

ADLS Gen2

Azure SQL

Azure Cloud

Python

Unity Catalog

Tools

GitHub Actions

Azure DevOps

Job description

Aroha Technologies, Inc. in Greenfield, IN is seeking an experienced Data Engineering Tech Lead to design, build, optimize, and maintain scalable Lakehouse solutions on Azure. You will drive batch and near-real-time data processing using Databricks, PySpark, ADF, ADLS Gen2, and Azure SQL.

Lead data pipelines across ERP, API, and relational sources, enforce data governance, and mentor engineers while advancing DevOps practices in the Azure cloud environment.