Databricks + Machine Learning Lead | Iris Star Tech | Abu Dhabi

Iris Star Tech; Abu Dhabi; In loco; AED 350.000 - 700.000; Tempo pieno

Descrizione del lavoro

Iris Star Tech in Abu Dhabi seeks a Databricks + Machine Learning Lead to own scalable lakehouse architecture using Azure Databricks and ADLS Gen2, guiding data engineering, ML platforms, and governance.

You will mentor engineers, drive CI/CD and IaC, work with C-level stakeholders, and deliver enterprise analytics solutions while optimizing cost and performance. This permanent role offers high visibility and a competitive package.

Competenze

• Bachelor’s or Master’s degree in Computer Science, Data Science, Software Engineering, Information Technology, or related discipline.
• 10 to 13 years of experience in data engineering and machine learning platforms.
• Hands-on expertise designing scalable Lakehouse architectures with Azure Databricks.
• Proficient in Azure Data Lake Storage Gen2, Spark, and distributed processing.
• Strong leadership, governance, and CI/CD automation experience.
• Willingness to work in Abu Dhabi, UAE.

Mansioni

• Lead architecture and design discussions for enterprise data and analytics use cases.
• Design Lakehouse architecture using Azure Databricks and ADLS Gen2.
• Define data ingestion, transformation, orchestration, and consumption frameworks.
• Architect and deploy batch and real-time data processing for reporting and AI/ML workloads.
• Develop data models supporting reporting, analytics, AI/ML, and BI requirements.
• Establish enterprise data governance, security, and monitoring standards.

Conoscenze

Leadership

Stakeholder management

Cross-functional communication

Mentorship

Formazione

Bachelor’s or Master’s degree in CS/DS/Engineering/IT

Strumenti

Azure Databricks

Azure Data Lake Storage Gen2

Spark

CI/CD automation

Infrastructure as Code (IaC)

Descrizione del lavoro

Position Summary

Driving advanced data architecture, scalable Lakehouse design, and enterprise machine learning transformation in Abu Dhabi, Iris Star Tech is actively seeking an accomplished Databricks + Machine Learning Lead for a permanent professional leadership engagement. In this vital technical leadership role, you will spearhead architecture and design discussions for cutting‑edge data and analytics use cases, defining ingestion, transformation, orchestration, and consumption frameworks. Bringing 10 to 13 years of progressive professional experience in data engineering and machine learning platforms, you will empower global enterprise analytics ecosystems to achieve uncompromised performance, cost optimization, and operational excellence. This prestigious career opportunity offers competitive remuneration, high executive visibility, and exceptional professional growth within a premier global IT consulting and data solutions enterprise.

Detailed Job Description

As a Databricks + Machine Learning Lead supporting Iris Star Tech in Abu Dhabi, UAE, you will take full operational, architectural, and tactical ownership of scalable Lakehouse architecture design using Azure Databricks and Azure Data Lake Storage Gen2. Your day‑to‑day responsibilities include architecting batch and real‑time data processing solutions, developing data models supporting reporting, analytics, AI/ML, and business intelligence requirements, establishing enterprise data governance, security, and monitoring standards, and driving CI/CD, DevOps, and Infrastructure as Code (IaC) initiatives. You will operate in a collaborative enterprise environment while collaborating closely with C‑level business stakeholders, data engineers, and technical development squads. Furthermore, you will manage application requirements by submitting your updated resume via direct email to Archana Ashok at [e-mail].

Key Responsibilities

• Lead architecture and design discussions for advanced enterprise data and analytics use cases across complex digital ecosystems.
• Design scalable Lakehouse architecture utilizing Azure Databricks and Azure Data Lake Storage Gen2 (ADLS Gen2).
• Define comprehensive data ingestion, transformation, orchestration, and consumption frameworks for high‑throughput pipelines.
• Architect and deploy robust batch and real‑time data processing solutions for enterprise‑grade reporting and AI/ML workloads.
• Develop sophisticated data models supporting advanced reporting, analytics, artificial intelligence, machine learning, and business intelligence requirements.
• Establish rigorous enterprise data governance, security protocols, and operational monitoring standards.
• Drive performance optimization, cost reduction, and platform scalability initiatives across cloud data infrastructures.
• Define and enforce CI/CD, DevOps, and Infrastructure as Code (IaC) standards for modern data platforms.
• Mentor data engineers, machine learning specialists, and provide technical leadership across distributed delivery teams.
• Support effort estimation, technical roadmap creation, and solution architecture presentations to executive stakeholders.

Required Qualifications & Skills

• Bachelor’s or Master’s degree in Computer Science, Data Science, Software Engineering, Information Technology, or related discipline.
• Minimum of 10 to 13 years of progressive professional experience in data engineering, big data architecture, and machine learning platforms.
• Strong, demonstrable hands‑on professional expertise designing scalable Lakehouse architectures with Azure Databricks.
• Comprehensive working knowledge and practical proficiency in Azure Data Lake Storage Gen2, Spark, and distributed data processing.
• Deep practical experience building batch and real‑time data ingestion pipelines and AI/ML serving models.
• Solid practical grasp of data governance, enterprise security, CI/CD automation, and Infrastructure as Code (IaC).
• Proven leadership, technical mentorship, stakeholder management, and cross‑functional communication capabilities.
• Mandatory legal work authorization and physical availability for professional operations in Abu Dhabi, UAE.

Nice‑to‑Have Skills

• Professional cloud and data certifications such as Databricks Certified Solutions Architect, Azure Solutions Architect Expert, or AWS Certified Data Analytics.
• Prior professional working experience in top‑tier IT consulting firms, global system integrators, or enterprise data‑driven corporations.
• Hands‑on familiarity with MLOps pipelines, MLflow, and automated machine learning deployment frameworks.
• Experience utilizing enterprise agile project management platforms (Jira, Confluence, Azure DevOps).
• Exposure to multi‑cloud data analytics architectures and enterprise governance frameworks (Purview, Collibra).

Application Information

• Recruiter: Iris Star Tech Recruitment Division
• Contact Name: Archana Ashok (Recruitment Manager – Technology)
• Email: [e-mail]
• Phone:
• Company Website: https://www.irisstar.tech
• Salary/Rate: Market Competitive / Enterprise Data Leadership Package
• Deadline: Urgent Abu Dhabi Databricks & Machine Learning Lead Opening (Open until filled)
• Notice Period: Immediate to 30 Days Preferred
• Contract Duration: Permanent / Full-Time Engagement (Abu Dhabi, UAE)