Senior Databricks Engineer

Cognizant; Dubai; On-site; AED 300,000 - 520,000; Full time

Job summary

Cognizant in Dubai is seeking a Databricks Expert to drive the next-gen platform uplift across our Lakehouse ecosystem. You will define industry-leading best practices and lead delivery, helping teams modernize data pipelines and governance.

The role involves designing Lakeflow jobs and scalable Lakehouse solutions, implementing Unity Catalog, DQX, DB Genie, and AI/BI workloads while mentoring teams and guiding technical decisions across the organization.

Qualifications

• 5+ years in data/platform engineering with Databricks expertise.
• Hands-on with PySpark, streaming, and Lakehouse components.
• Experience with ADF, Synapse, and Azure DevOps.
• Proven leadership in large-scale Databricks/Lakehouse projects.
• Strong problem-solving and delivery leadership.

Responsibilities

• Lead modernization of Databricks platform and adoption of advanced features.
• Design and deliver Lakeflow jobs, pipelines, and scalable Lakehouse solutions.
• Implement and optimize Unity Catalog, DQX, DB Genie, AI/BI workloads.
• Establish engineering governance, automation frameworks, and best practices.
• Mentor teams and guide technical decision-making across the organization.

Skills

Databricks

PySpark

Streaming

Delta Lake

Lakeflow

Unity Catalog

DQX

DB Genie

Azure DevOps

Azure Data Factory

Azure Synapse

Tools

Azure Data Factory

Azure Synapse Analytics

DB Genie

Job description

Job Summary

Looking for a Databricks Expert to drive next‑gen platform uplift, define best practices, and lead delivery across our Lakehouse ecosystem.

Responsibilities

• Lead modernization of Databricks platform and adoption of advanced features.
• Design and deliver Lakeflow jobs, pipelines, and scalable Lakehouse solutions.
• Implement and optimize Unity Catalog, DQX, DB Genie, AI/BI workloads.
• Establish engineering best practices, governance, and automation frameworks.
• Along with the individual contribution, mentor teams and guide technical decision‑making across the organization.

Requirements

• Around 5+ years in data/platform engineering with deep Databricks expertise
• Strong Hands‑on experience with Pyspark, Streaming, DBR, Lakeflow, UC, DQX, DB Genie, Delta Lake
• Experienced in ADF, Synapse and exposure to Azure DevOPs
• Proven leadership in large‑scale Databricks or Lakehouse transformation projects
• Strong out of the box thinking, problem‑solving, and deliverables leadership