Azure Data Engineer Lead - Lakehouse & PySpark

Talendica; Greenfield (IN); On-site; USD 120,000 - 180,000; Full time

Job summary

Talendica in Greenfield, IN seeks an experienced Data Engineering Tech Lead to design, develop, and optimize scalable Lakehouse solutions using Azure Databricks, PySpark, ADF, ADLS Gen2, Azure SQL and Python. You will lead batch and near-real-time data processing and mentor engineers while implementing robust cloud data platforms.

Join a team that drives best practices in data engineering, cloud architecture, and scalable analytics, delivering enterprise-grade data solutions and ongoing

Qualifications

• 4+ years of experience in Azure Databricks with PySpark.
• 2+ years of experience in Databricks workflow & Unity catalog.
• 3+ years of experience in ADF (Azure Data Factory).
• 3+ years of experience in ADLS Gen 2.
• 3+ years of experience in Azure SQL.
• 5+ years of experience in Azure Cloud platform.
• 2+ years of experience in Python programming & package builds.

Skills

Python programming

Tools

Azure Databricks

Databricks Workflow

Unity Catalog

Azure Data Factory (ADF)

ADLS Gen2

Azure SQL

Azure Cloud Platform

Job description

Talendica in Greenfield, IN seeks an experienced Data Engineering Tech Lead to design, develop, and optimize scalable Lakehouse solutions using Azure Databricks, PySpark, ADF, ADLS Gen2, Azure SQL and Python. You will lead batch and near-real-time data processing and mentor engineers while implementing robust cloud data platforms.

Join a team that drives best practices in data engineering, cloud architecture, and scalable analytics, delivering enterprise-grade data solutions and ongoing