Azure Databricks Engineer

Durapid Technologies Private Limited; Hyderabad; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Durapid Technologies Private Limited is seeking an experienced Azure Databricks Engineer to design, build, and optimize modern data platforms. You will own end-to-end data engineering deliverables, from pipeline development to production support, collaborating with business and analytics stakeholders in Hyderabad, India.

The role focuses on real-time streaming, Delta Lake architecture, and Generative AI-driven analytics, requiring strong Databricks expertise and the ability to work with

Qualifications

• Databricks expertise with PySpark/SQL, Workflows/Jobs orchestration, Delta Lake and Unity Catalog.
• Working knowledge of Azure Data Factory.
• Experience with Lakeflow (Declarative Pipelines/Connect) including CDC and data quality validations.
• Exposure to Databricks AI/BI or Genie (semantic layers, certified datasets).
• Familiarity with CI/CD and version control (Git, Databricks Repos/Asset Bundles).
• Ability to own deliverables end-to-end and communicate with stakeholders.

Skills

Azure Databricks

Delta Lake

Delta Table Streaming

PySpark

Unity Catalog

Medallion Architecture

Azure Data Factory

Gen AI (LLM, RAG)

CI/CD

Git

Tools

Lakeflow

Databricks Workflows/Jobs

Job description

Role Overview

We are hiring an experienced Azure Databricks Engineer to design, build, and optimize modern data platforms covering real-time streaming, Delta Lake architecture, and Generative AI-driven analytics. The role requires end-to-end ownership of data engineering deliverables, from pipeline development to production support, while collaborating closely with business and analytics stakeholders.

Key Skills

Azure Databricks | Delta Lake | Delta Table Streaming | PySpark | Unity Catalog | Medallion Architecture | Azure Data Factory | Gen AI (LLM, RAG)

Must-Have Skills

• Strong hands-on Databricks expertise - PySpark/SQL, Workflows/Jobs orchestration, Delta Lake, Unity Catalog
• Working knowledge of Azure Data Factory
• Experience with Lakeflow (Declarative Pipelines/Connect) including CDC and data quality validations
• Exposure to Databricks AI/BI or Genie (semantic layers, certified datasets)
• Familiarity with CI/CD and version control (Git, Databricks Repos/Asset Bundles)
• Demonstrated ability to own deliverables fully and resolve issues independently
• Strong communication skills for working with business/analytics stakeholders

Eligibility

• 5-10 years of relevant data engineering experience
• Valid passport with minimum 1 year validity is mandatory
• Willingness to be based at any of the listed locations

Skills: architecture,azure,data engineering