Azure Databricks Engineer

Durapid Technologies Private Limited; Gurugram District; On-site; INR 2,500,000 - 4,200,000; Full time

Job summary

Durapid Technologies Private Limited is seeking an experienced Azure Databricks Engineer to design, build, and optimize modern data platforms including real-time streaming, Delta Lake architecture, and Gen AI-driven analytics.

The role requires end-to-end ownership of data engineering deliverables and close collaboration with business and analytics stakeholders to drive impactful insights.

Qualifications

• 5-10 years of hands-on data engineering in modern data platforms.
• Experience designing Delta Lake architectures and streaming pipelines.
• Proficient in PySpark, SQL, and Databricks workflows.
• Strong collaboration with business and analytics stakeholders.
• Willing to be based in India with mobility as needed.

Responsibilities

• Design, build, and optimize data platforms end-to-end.
• Own production-ready data pipelines and data quality checks.
• Collaborate with analytics teams to deliver Gen AI-driven insights.

Skills

Azure Databricks

Delta Lake

Delta Table Streaming

PySpark

Unity Catalog

Medallion Architecture

Azure Data Factory

Gen AI (LLM, RAG)

Job description

Role Overview

We are hiring an experienced Azure Databricks Engineer to design, build, and optimize modern data platforms covering real-time streaming, Delta Lake architecture, and Generative AI-driven analytics. The role requires end-to-end ownership of data engineering deliverables, from pipeline development to production support, while collaborating closely with business and analytics stakeholders.

Key Skills

Azure Databricks | Delta Lake | Delta Table Streaming | PySpark | Unity Catalog | Medallion Architecture | Azure Data Factory | Gen AI (LLM, RAG)

Must-Have Skills

• Strong hands-on Databricks expertise - PySpark/SQL, Workflows/Jobs orchestration, Delta Lake, Unity Catalog
• Working knowledge of Azure Data Factory
• Experience with Lakeflow (Declarative Pipelines/Connect) including CDC and data quality validations
• Exposure to Databricks AI/BI or Genie (semantic layers, certified datasets)
• Familiarity with CI/CD and version control (Git, Databricks Repos/Asset Bundles)
• Demonstrated ability to own deliverables fully and resolve issues independently
• Strong communication skills for working with business/analytics stakeholders

Eligibility

• 5-10 years of relevant data engineering experience
• Valid passport with minimum 1 year validity is mandatory
• Willingness to be based at any of the listed locations

Skills: architecture,azure,data engineering