Azure Databricks Engineer

Durapid Technologies Private Limited; Chennai District; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

Durapid Technologies Private Limited in Chennai is seeking an experienced Azure Databricks Engineer to design, build, and optimize modern data platforms covering real-time streaming, Delta Lake architecture, and Generative AI analytics.

The role requires end-to-end ownership of data engineering deliverables, from pipeline development to production support, while collaborating closely with business and analytics stakeholders.

Qualifications

• Strong hands-on Databricks expertise - PySpark/SQL, Workflows/Jobs orchestration, Delta Lake, Unity Catalog.
• Working knowledge of Azure Data Factory.
• Experience with Lakeflow (Declarative Pipelines/Connect) including CDC and data quality validations.
• Exposure to Databricks AI/BI or Genie (semantic layers, certified datasets).
• Familiarity with CI/CD and version control (Git, Databricks Repos/Asset Bundles).
• Demonstrated ability to own deliverables fully and resolve issues independently.
• Strong communication skills for working with business/analytics stakeholders.

Skills

Azure Databricks

Delta Lake

Delta Table Streaming

PySpark

Unity Catalog

Medallion Architecture

Azure Data Factory

Gen AI (LLM, RAG)

Tools

Databricks Repos

Git

Asset Bundles

Job description

Role Overview

We are hiring an experienced Azure Databricks Engineer to design, build, and optimize modern data platforms covering real-time streaming, Delta Lake architecture, and Generative AI-driven analytics. The role requires end-to-end ownership of data engineering deliverables, from pipeline development to production support, while collaborating closely with business and analytics stakeholders.

Key Skills

Azure Databricks | Delta Lake | Delta Table Streaming | PySpark | Unity Catalog | Medallion Architecture | Azure Data Factory | Gen AI (LLM, RAG)

Must-Have Skills

• Strong hands-on Databricks expertise - PySpark/SQL, Workflows/Jobs orchestration, Delta Lake, Unity Catalog
• Working knowledge of Azure Data Factory
• Experience with Lakeflow (Declarative Pipelines/Connect) including CDC and data quality validations
• Exposure to Databricks AI/BI or Genie (semantic layers, certified datasets)
• Familiarity with CI/CD and version control (Git, Databricks Repos/Asset Bundles)
• Demonstrated ability to own deliverables fully and resolve issues independently
• Strong communication skills for working with business/analytics stakeholders

Eligibility

• 5-10 years of relevant data engineering experience
• Valid passport with minimum 1 year validity is mandatory
• Willingness to be based at any of the listed locations

Skills: architecture,azure,data engineering