Azure Databricks Engineer

Durapid Technologies Private Limited; Bengaluru; On-site; INR 2,500,000 - 4,200,000; Full time

Job summary

Durapid Technologies Private Limited is seeking an experienced Azure Databricks Engineer to design, build, and optimize modern data platforms with real-time streaming, Delta Lake, and Gen AI analytics. You will own end‑to‑end data engineering deliverables from pipelines to production support.

You will collaborate closely with business and analytics stakeholders to ensure scalable, reliable data solutions across the enterprise.

Qualifications

• Strong hands-on Databricks expertise - PySpark/SQL, Workflows/Jobs orchestration, Delta Lake, Unity Catalog
• Experience with Lakeflow (Declarative Pipelines/Connect) including CDC and data quality validations
• Exposure to Databricks AI/BI or Genie (semantic layers, certified datasets)

Skills

Azure Databricks

Delta Lake

Delta Table Streaming

PySpark

Unity Catalog

Medallion Architecture

Azure Data Factory

Gen AI

Tools

Lakeflow

Databricks Repos

Git

Job description

Role Overview

We are hiring an experienced Azure Databricks Engineer to design, build, and optimize modern data platforms covering real-time streaming, Delta Lake architecture, and Generative AI-driven analytics. The role requires end-to-end ownership of data engineering deliverables, from pipeline development to production support, while collaborating closely with business and analytics stakeholders.

Key Skills

Azure Databricks | Delta Lake | Delta Table Streaming | PySpark | Unity Catalog | Medallion Architecture | Azure Data Factory | Gen AI (LLM, RAG)

Must-Have Skills

• Strong hands-on Databricks expertise - PySpark/SQL, Workflows/Jobs orchestration, Delta Lake, Unity Catalog
• Working knowledge of Azure Data Factory
• Experience with Lakeflow (Declarative Pipelines/Connect) including CDC and data quality validations
• Exposure to Databricks AI/BI or Genie (semantic layers, certified datasets)
• Familiarity with CI/CD and version control (Git, Databricks Repos/Asset Bundles)
• Demonstrated ability to own deliverables fully and resolve issues independently
• Strong communication skills for working with business/analytics stakeholders

Eligibility

• 5-10 years of relevant data engineering experience
• Valid passport with minimum 1 year validity is mandatory
• Willingness to be based at any of the listed locations

Skills: architecture,azure,data engineering