Senior Databricks Engineer & Lakehouse Platform Lead

Cognizant Consulting; United Arab Emirates; On-site; AED 280,000 - 460,000; Full time

Job summary

Cognizant Consulting is seeking a senior data/platform engineer to lead the modernization of the Databricks platform and drive scalable Lakehouse initiatives. You will design Lakeflow pipelines, implement Unity Catalog and related tooling, and establish governance and automation) practices across teams.

The role requires deep Databricks expertise with PySpark, streaming, and Delta Lake, plus proven leadership in large‑scale transformations.

Qualifications

• 6+ years in data/platform engineering with Databricks focus.
• Strong hands-on experience with PySpark, streaming and lakehouse tooling.
• Leadership in large-scale Databricks or Lakehouse transformations.

Responsibilities

• Lead modernization of the Databricks platform and adoption of advanced features.
• Design and deliver Lakeflow jobs, pipelines, and scalable Lakehouse solutions.
• Implement and optimize Unity Catalog, DQX, DB Genie, AI/BI workloads.
• Establish engineering best practices, governance, and automation frameworks.
• Mentor teams and guide technical decision‑making across the organization.

Skills

Databricks expertise

Pyspark

Streaming

Lakeflow

Unity Catalog

Azure DevOps

Leadership

Problem solving

Tools

ADF (Azure Data Factory)

Synapse

DB Genie

DQX

Delta Lake

DBR

Job description

Cognizant Consulting is seeking a senior data/platform engineer to lead the modernization of the Databricks platform and drive scalable Lakehouse initiatives. You will design Lakeflow pipelines, implement Unity Catalog and related tooling, and establish governance and automation) practices across teams.

The role requires deep Databricks expertise with PySpark, streaming, and Delta Lake, plus proven leadership in large‑scale transformations.