Azure Databricks Platform Lead – Senior Data Engineer

Cactus International; Abu Dhabi; Hybrid; AED 360,000 - 540,000; Full time

Job summary

Cactus International in Abu Dhabi, UAE, is seeking a Data Platform Lead to own and evolve the Azure Databricks platform. You will lead data engineering efforts, define platform standards, and govern productive pipelines while mentoring two engineers.

The role combines hands-on platform work (60–70%) with leadership responsibilities, shaping data products, AI-ready datasets, and scalable analytics capabilities. Hybrid work: 4 days in office, 1 day from home.

Qualifications

• 7+ years of experience in data engineering, data platforms, cloud data architecture, or enterprise data integration.
• Hands-on experience with Azure Databricks, Delta Lake, and Lakehouse.
• Experience leading Data Engineers and providing technical direction across initiatives.
• Experience integrating ERP, CRM, SaaS platforms, PostgreSQL, SQL Server, Oracle, APIs, and files.
• Strong ownership mindset and ability to translate business needs into scalable data solutions.

Responsibilities

• Own the technical configuration and ongoing evolution of the Azure Databricks platform, including governance and workload separation.
• Lead data ingestion from ERP, databases, SaaS, APIs and files into the Lakehouse.
• Define reusable engineering patterns for full/incremental loads, CDC, schema evolution, and data quality.
• Ensure production pipelines include mapping, ownership, monitoring, and documentation.
• Mentor two Data Engineers and establish engineering standards and reviews.
• Oversee monitoring, incident response, and platform cost controls.

Skills

Data platform leadership

Cloud data engineering

Stakeholder management

Mentoring and coaching

System design and governance

Tools

Azure Databricks

Delta Lake

Unity Catalog

Azure Data Lake Storage

GitHub/Azure DevOps

Job description

Cactus International in Abu Dhabi, UAE, is seeking a Data Platform Lead to own and evolve the Azure Databricks platform. You will lead data engineering efforts, define platform standards, and govern productive pipelines while mentoring two engineers.

The role combines hands-on platform work (60–70%) with leadership responsibilities, shaping data products, AI-ready datasets, and scalable analytics capabilities. Hybrid work: 4 days in office, 1 day from home.