Senior Databricks Engineer

Cognizant Consulting; United Arab Emirates; On-site; AED 280,000 - 460,000; Full time

Job summary

Cognizant Consulting is seeking a senior data/platform engineer to lead the modernization of the Databricks platform and drive scalable Lakehouse initiatives. You will design Lakeflow pipelines, implement Unity Catalog and related tooling, and establish governance and automation) practices across teams.

The role requires deep Databricks expertise with PySpark, streaming, and Delta Lake, plus proven leadership in large‑scale transformations.

Qualifications

• 6+ years in data/platform engineering with Databricks focus.
• Strong hands-on experience with PySpark, streaming and lakehouse tooling.
• Leadership in large-scale Databricks or Lakehouse transformations.

Responsibilities

• Lead modernization of the Databricks platform and adoption of advanced features.
• Design and deliver Lakeflow jobs, pipelines, and scalable Lakehouse solutions.
• Implement and optimize Unity Catalog, DQX, DB Genie, AI/BI workloads.
• Establish engineering best practices, governance, and automation frameworks.
• Mentor teams and guide technical decision‑making across the organization.

Skills

Databricks expertise

Pyspark

Streaming

Lakeflow

Unity Catalog

Azure DevOps

Leadership

Problem solving

Tools

ADF (Azure Data Factory)

Synapse

DB Genie

DQX

Delta Lake

DBR

Job description

Responsibilities

Job Summary

• Lead modernization of Databricks platform and adoption of advanced features.
• Design and deliver Lakeflow jobs, pipelines, and scalable Lakehouse solutions.
• Implement and optimize Unity Catalog, DQX, DB Genie, AI/BI workloads.
• Establish engineering best practices, governance, and automation frameworks.
• Along with the individual contribution, mentor teams and guide technical decision‑making across the organization.

Requirements

• 6 plus years in data/platform engineering with deep Databricks expertise
• Strong Hands‑on experience with Pyspark, Streaming, DBR, Lakeflow, UC, DQX, DB Genie, Delta Lake
• Experienced in ADF, Synapse and exposure to Azure DevOPs
• Proven leadership in large‑scale Databricks or Lakehouse transformation projects
• Strong out of the box thinking, problem‑solving, and deliverables leadership