Lead Databricks Architect — Enterprise Data Platform

Strike IT Recruitment Services; Abu Dhabi; Hybrid; AED 279,000 - 446,000; Part time

Benefits offered by this job

Hybrid working model in Abu Dhabi

Contract role with extension potential

Job summary

Strike IT Recruitment Services is seeking a Databricks Lead for a major digital transformation programme in Abu Dhabi. You will design and deliver modern data platform capabilities at scale, collaborating with architects, engineering teams and senior stakeholders to drive strategic data initiatives.

The role requires extensive Databricks leadership, deep Delta Lake/Spark knowledge, and strong cloud experience across Azure, AWS or GCP.

Qualifications

• Extensive hands-on Databricks experience in a Lead, Principal, or Architect capacity.
• Strong experience designing and delivering enterprise-scale data platforms and solutions.
• Deep knowledge of Databricks Lakehouse architecture, Delta Lake, and Apache Spark.
• Strong hands-on experience with PySpark and Spark SQL.
• Experience building large-scale ETL/ELT pipelines and modern data architectures.
• Strong experience with cloud platforms such as Azure, AWS, or GCP.
• Experience implementing CI/CD pipelines and DevOps practices.
• Strong understanding of data governance, security, and platform best practices.
• Excellent stakeholder management and communication skills.
• Proven experience leading and mentoring technical teams.
• Experience operating within large, complex, global organisations.

Responsibilities

• Lead the architecture, design, and implementation of enterprise-scale solutions using Databricks.
• Provide technical leadership and direction across multiple data engineering workstreams.
• Design and build scalable, secure, and high-performing data platforms and pipelines.
• Define engineering standards, best practices, and governance across the Databricks ecosystem.
• Work closely with business and technology stakeholders to translate requirements into technical solutions.
• Drive platform optimisation, performance tuning, and continuous improvement initiatives.
• Support technical planning, solution estimation, and roadmap definition.
• Mentor and coach engineering teams, promoting engineering excellence and best practices.
• Ensure solutions align with enterprise architecture, security, and governance standards.

Skills

Databricks

PySpark

Spark SQL

Cloud platforms

Tools

CI/CD

DevOps

Delta Lake

Spark

Job description

Strike IT Recruitment Services is seeking a Databricks Lead for a major digital transformation programme in Abu Dhabi. You will design and deliver modern data platform capabilities at scale, collaborating with architects, engineering teams and senior stakeholders to drive strategic data initiatives.

The role requires extensive Databricks leadership, deep Delta Lake/Spark knowledge, and strong cloud experience across Azure, AWS or GCP.