Azure Data Lakehouse Tech Lead

Noblesoft Technologies Inc.; Greenfield (IN); On-site; USD 140,000 - 190,000; Full time

Job summary

Noblesoft Technologies Inc. is seeking an experienced Azure Data Engineer Lead to design, develop, and optimize scalable data lakehouse solutions on Azure. You will drive batch and near-real-time processing and guide a team of engineers across multiple projects.

The role requires deep expertise in Databricks, PySpark, ADF, ADLS Gen2, Azure SQL, Python, and Azure Cloud, with strong emphasis on governance, security, and DevOps practices. Onsite work in Greenfield, IN is expected.

Qualifications

• 4+ years of experience in Azure Databricks with PySpark.
• 2+ years of experience in Databricks workflow & Unity catalog.
• 3+ years of experience in ADF (Azure Data Factory).
• 3+ years of experience in ADLS Gen 2.
• 3+ years of experience in Azure SQL.
• 5+ years of experience in Azure Cloud platform.
• 2+ years of experience in Python programming & package builds.

Responsibilities

• Lead design, development, optimization, and maintenance of scalable enterprise data engineering and Lakehouse solutions.
• Oversee batch and near-real-time data processing pipelines.
• Mentor junior engineers and guide technical direction across projects.
• Collaborate with stakeholders to ensure data governance and security across the Lakehouse.

Skills

Azure Databricks

PySpark

ADF

ADLS Gen2

Azure SQL

Python

Unity Catalog

Delta Lake

Azure Cloud

CI/CD

Git

Azure DevOps

Education

Bachelor's degree

Job description

Noblesoft Technologies Inc. is seeking an experienced Azure Data Engineer Lead to design, develop, and optimize scalable data lakehouse solutions on Azure. You will drive batch and near-real-time processing and guide a team of engineers across multiple projects.

The role requires deep expertise in Databricks, PySpark, ADF, ADLS Gen2, Azure SQL, Python, and Azure Cloud, with strong emphasis on governance, security, and DevOps practices. Onsite work in Greenfield, IN is expected.