Databricks ML (Lead)

LTM; Abu Dhabi; Presencial; AED 300.000 - 420.000; Jornada completa

Descripción de la vacante

LTM in Abu Dhabi is seeking a senior data platform architect to lead architecture and design discussions for data and analytics use cases. You will design a scalable Lakehouse using Azure Databricks and Azure Data Lake Storage Gen2, enabling robust data ingestion, processing, and governance across the organization.

You will mentor engineers, drive CI/CD and IaC standards for data platforms, and collaborate with stakeholders to translate business requirements into scalable technical solutions

Formación

• Lead architecture and design discussions for new data and analytics use cases.
• Design scalable Lakehouse architecture using Azure Databricks and Azure Data Lake Storage Gen2.
• Define data ingestion transformation orchestration and consumption frameworks.
• Architect batch and realtime data processing solutions.
• Develop data models supporting reporting analytics AIML and business intelligence requirements.
• Establish enterprise data governance security and monitoring standards.
• Collaborate with business stakeholders to translate business requirements into technical solutions.
• Drive performance optimization cost optimization and platform scalability initiatives.
• Define CICD DevOps and Infrastructure as Code standards for data platforms.
• Mentor data engineers and provide technical leadership across delivery teams.
• Support effort estimation technical roadmap creation and solution.

Descripción del empleo

• Lead architecture and design discussions for new data and analytics use cases
• Design scalable Lakehouse architecture using Azure Databricks and Azure Data Lake Storage Gen2
• Define data ingestion transformation orchestration and consumption frameworks
• Architect batch and realtime data processing solutions
• Develop data models supporting reporting analytics AIML and business intelligence requirements
• Establish enterprise data governance security and monitoring standards
• Collaborate with business stakeholders to translate business requirements into technical solutions
• Drive performance optimization cost optimization and platform scalability initiatives
• Define CICD DevOps and Infrastructure as Code standards for data platforms
• Mentor data engineers and provide technical leadership across delivery teams
• Support effort estimation technical roadmap creation and solution