Databricks + ML Lead: Enterprise Lakehouse Architect

Iris Star Tech; Abu Dhabi; On-site; AED 350,000 - 700,000; Full time

Job summary

Iris Star Tech in Abu Dhabi seeks a Databricks + Machine Learning Lead to own scalable lakehouse architecture using Azure Databricks and ADLS Gen2, guiding data engineering, ML platforms, and governance.

You will mentor engineers, drive CI/CD and IaC, work with C-level stakeholders, and deliver enterprise analytics solutions while optimizing cost and performance. This permanent role offers high visibility and a competitive package.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Data Science, Software Engineering, Information Technology, or related discipline.
• 10 to 13 years of experience in data engineering and machine learning platforms.
• Hands-on expertise designing scalable Lakehouse architectures with Azure Databricks.
• Proficient in Azure Data Lake Storage Gen2, Spark, and distributed processing.
• Strong leadership, governance, and CI/CD automation experience.
• Willingness to work in Abu Dhabi, UAE.

Responsibilities

• Lead architecture and design discussions for enterprise data and analytics use cases.
• Design Lakehouse architecture using Azure Databricks and ADLS Gen2.
• Define data ingestion, transformation, orchestration, and consumption frameworks.
• Architect and deploy batch and real-time data processing for reporting and AI/ML workloads.
• Develop data models supporting reporting, analytics, AI/ML, and BI requirements.
• Establish enterprise data governance, security, and monitoring standards.

Skills

Leadership

Stakeholder management

Cross-functional communication

Mentorship

Education

Bachelor’s or Master’s degree in CS/DS/Engineering/IT

Tools

Azure Databricks

Azure Data Lake Storage Gen2

Spark

CI/CD automation

Infrastructure as Code (IaC)

Job description

Iris Star Tech in Abu Dhabi seeks a Databricks + Machine Learning Lead to own scalable lakehouse architecture using Azure Databricks and ADLS Gen2, guiding data engineering, ML platforms, and governance.

You will mentor engineers, drive CI/CD and IaC, work with C-level stakeholders, and deliver enterprise analytics solutions while optimizing cost and performance. This permanent role offers high visibility and a competitive package.