Azure Lakehouse Tech Lead — Databricks & ADF Expert

Noblesoft Technologies Inc.; Greenfield (IN); On-site; USD 120,000 - 180,000; Full time

Job summary

Noblesoft Technologies Inc. seeks an experienced Azure Data Engineer Lead to architect and implement enterprise-grade data lakehouse solutions on Azure.

You will drive design, development, and optimization of batch and near-real-time data processing, ensuring governance, security, and scalable performance. The role requires deep expertise in Azure Databricks, PySpark, ADF, ADLS Gen2, Azure SQL, and Python, with hands-on leadership to mentor engineers and deliver robust data platforms for

Qualifications

• 4+ years of experience in Azure Databricks with PySpark.
• 2+ years of experience in Databricks workflow & Unity catalog.
• 3+ years of experience in ADF (Azure Data Factory).
• 3+ years of experience in ADLS Gen 2.
• 3+ years of experience in Azure SQL.
• 5+ years of experience in Azure Cloud platform.
• 2+ years of experience in Python programming & package builds.

Responsibilities

• Lead solution design discussions and mentor junior engineers.
• Design, develop, and optimize scalable data pipelines on Azure data services.
• Govern data access, lineage, and security across lakehouse with Unity Catalog.
• Ensure reliable batch and near-real-time data processing.
• Collaborate with product owners, QA, and analysts to translate requirements into deliverables.

Skills

Azure Databricks

PySpark

ADF

ADLS Gen2

Azure SQL

Azure Cloud

Python

Unity Catalog

Delta Lake

CI/CD

Git

Azure DevOps

Education

Bachelor's degree

Tools

Git

Azure DevOps

Terraform

ARM/Bicep

PyTest

Job description

Noblesoft Technologies Inc. seeks an experienced Azure Data Engineer Lead to architect and implement enterprise-grade data lakehouse solutions on Azure.

You will drive design, development, and optimization of batch and near-real-time data processing, ensuring governance, security, and scalable performance. The role requires deep expertise in Azure Databricks, PySpark, ADF, ADLS Gen2, Azure SQL, and Python, with hands-on leadership to mentor engineers and deliver robust data platforms for