Azure Databricks Engineer

Durapid Technologies Private Limited; Jaipur; On-site; INR 1,500,000 - 2,300,000; Full time

Job summary

Durapid Technologies Private Limited is seeking an experienced Azure Databricks Engineer to design, build, and optimize modern data platforms covering real-time streaming, Delta Lake architecture, and Gen AI analytics. You will own data pipelines end-to-end from development to production support.

You will work closely with business and analytics teams, ensure data quality, governance with Unity Catalog, and help implement scalable data solutions using PySpark, Delta Lake, and Lakeflow.

Qualifications

• Strong hands-on Databricks expertise with PySpark/SQL, Delta Lake, Unity Catalog.
• Experience with Azure Data Factory for data orchestration.
• Familiarity with Lakeflow for declarative pipelines and CDC checks.
• Exposure to Gen AI/Genie semantic layers and certified datasets.

Responsibilities

• Design, build, and optimize modern data platforms including Delta Lake and real-time streaming.
• Own end-to-end data engineering deliverables from development to production support.
• Collaborate with business and analytics stakeholders to align data solutions with needs.
• Ensure data quality, governance, and CI/CD practices across pipelines.

Skills

Databricks expertise

CI/CD & version control

Stakeholder communication

Delivery ownership

Tools

Databricks PySpark

Azure Data Factory

Lakeflow

Gen AI / Genie

Git & Databricks Repos

Job description

Role Overview

We are hiring an experienced Azure Databricks Engineer to design, build, and optimize modern data platforms covering real-time streaming, Delta Lake architecture, and Generative AI-driven analytics. The role requires end-to-end ownership of data engineering deliverables, from pipeline development to production support, while collaborating closely with business and analytics stakeholders.

Key Skills

Azure Databricks | Delta Lake | Delta Table Streaming | PySpark | Unity Catalog | Medallion Architecture | Azure Data Factory | Gen AI (LLM, RAG)

Must-Have Skills

• Strong hands-on Databricks expertise - PySpark/SQL, Workflows/Jobs orchestration, Delta Lake, Unity Catalog
• Working knowledge of Azure Data Factory
• Experience with Lakeflow (Declarative Pipelines/Connect) including CDC and data quality validations
• Exposure to Databricks AI/BI or Genie (semantic layers, certified datasets)
• Familiarity with CI/CD and version control (Git, Databricks Repos/Asset Bundles)
• Demonstrated ability to own deliverables fully and resolve issues independently
• Strong communication skills for working with business/analytics stakeholders

Eligibility

• 5-10 years of relevant data engineering experience
• Valid passport with minimum 1 year validity is mandatory
• Willingness to be based at any of the listed locations

Skills: architecture,azure,data engineering