Azure Databricks Engineer

Durapid Technologies Private Limited; Bhopal; On-site; INR 900,000 - 1,800,000; Full time

Job summary

We are hiring an experienced Azure Databricks Engineer to design, build, and optimize modern data platforms covering real-time streaming, Delta Lake architecture, and Generative AI-driven analytics. The role requires end-to-end ownership of data engineering deliverables, from pipeline development to production support, while collaborating closely with business and analytics stakeholders.

The candidate will own data pipelines from development to production, collaborate with business and analytics

Qualifications

• 5-10 years of relevant data engineering experience.
• Valid passport with minimum 1 year validity is mandatory.
• Willingness to be based at any of the listed locations.

Responsibilities

• Design, build, and optimize modern data platforms covering real-time streaming, Delta Lake architecture, and Gen AI-driven analytics.
• Own end-to-end data engineering deliverables from pipeline development to production support.
• Collaborate closely with business and analytics stakeholders.

Skills

Azure Databricks

Delta Lake

Delta Table Streaming

PySpark

Unity Catalog

Medallion Architecture

Azure Data Factory

Gen AI

Tools

Git

CI/CD

Databricks Repos

Asset Bundles

Lakeflow

Job description

Role Overview

We are hiring an experienced Azure Databricks Engineer to design, build, and optimize modern data platforms covering real-time streaming, Delta Lake architecture, and Generative AI-driven analytics. The role requires end-to-end ownership of data engineering deliverables, from pipeline development to production support, while collaborating closely with business and analytics stakeholders.

Key Skills

Azure Databricks | Delta Lake | Delta Table Streaming | PySpark | Unity Catalog | Medallion Architecture | Azure Data Factory | Gen AI (LLM, RAG)

Must-Have Skills

• Strong hands-on Databricks expertise - PySpark/SQL, Workflows/Jobs orchestration, Delta Lake, Unity Catalog
• Working knowledge of Azure Data Factory
• Experience with Lakeflow (Declarative Pipelines/Connect) including CDC and data quality validations
• Exposure to Databricks AI/BI or Genie (semantic layers, certified datasets)
• Familiarity with CI/CD and version control (Git, Databricks Repos/Asset Bundles)
• Demonstrated ability to own deliverables fully and resolve issues independently
• Strong communication skills for working with business/analytics stakeholders

Eligibility

• 5-10 years of relevant data engineering experience
• Valid passport with minimum 1 year validity is mandatory
• Willingness to be based at any of the listed locations

Skills: architecture,azure,data engineering