Azure Data Lakehouse Tech Lead (Databricks/PySpark)

WinWire Technologies Inc.; Greenfield (IN); On-site; USD 140,000 - 200,000; Full time

Job summary

WinWire Technologies Inc. is seeking an experienced Data Engineering Tech Lead to design, develop, and optimize scalable lakehouse solutions on Azure. You will guide batch and near-real-time data processing, leading a team and ensuring data quality and governance across platforms.

The role requires strong expertise in Databricks, PySpark, Unity Catalog, ADF, ADLS Gen2, and Azure SQL, with a track record of delivering enterprise data pipelines on the Azure cloud.

Qualifications

• 4+ years of experience in Azure Databricks with PySpark.
• 2+ years in Databricks Workflows and Unity Catalog.
• 3+ years in ADF (Azure Data Factory).
• 3+ years in ADLS Gen2.
• 3+ years in Azure SQL.
• 5+ years in Azure Cloud platform.
• 2+ years in Python programming and packaging.

Responsibilities

• Lead design, development, optimization, and maintenance of data engineering and Lakehouse solutions.
• Ensure reliable batch and near-real-time data processing.
• Mentor junior engineers and lead solution design discussions.
• Prepare design documents and architecture diagrams.

Skills

Azure Databricks PySpark

Databricks Workflows Unity Catalog

Azure Data Factory

ADLS Gen2

Azure SQL

Azure Cloud

Python programming

Tools

Databricks Workspace

Azure ecosystem tooling

Job description

WinWire Technologies Inc. is seeking an experienced Data Engineering Tech Lead to design, develop, and optimize scalable lakehouse solutions on Azure. You will guide batch and near-real-time data processing, leading a team and ensuring data quality and governance across platforms.

The role requires strong expertise in Databricks, PySpark, Unity Catalog, ADF, ADLS Gen2, and Azure SQL, with a track record of delivering enterprise data pipelines on the Azure cloud.