Databricks ML (Lead )

LTM; United Arab Emirates; On-site; AED 300,000 - 520,000; Full time

Job summary

LTM in UAE is seeking a Lead Data Architect to drive architecture and design discussions for advanced data and analytics use cases. You will design scalable Lakehouse solutions with Azure Databricks and ADLS Gen2, define ingestion and processing frameworks, and mentor delivering teams.

The role emphasizes governance, security, and collaboration with stakeholders, with hands-on coding as needed to deliver results.

Qualifications

• Lead architecting data and analytics solutions.
• Experience leading data engineering teams.
• Ability to work independently on coding tasks.

Responsibilities

• Lead architecture and design discussions for data and analytics use cases.
• Design scalable Lakehouse architecture using Azure Databricks and Azure Data Lake Storage Gen2.
• Define data ingestion transformation orchestration and consumption frameworks.
• Architect batch and realtime data processing solutions.
• Develop data models supporting reporting analytics AIML and BI requirements.
• Establish enterprise data governance, security and monitoring standards.
• Collaborate with business stakeholders to translate requirements into technical solutions.
• Drive performance, cost optimization and platform scalability initiatives.
• Define CI/CD and IaC standards for data platforms.
• Mentor data engineers and provide technical leadership across delivery teams.
• Support effort estimation, technical roadmap creation and solution delivery.

Skills

Azure Databricks

Azure Data Lake Storage Gen2

Data architecture

Lead / mentoring

DevOps / CI/CD

IaC

Performance tuning

Security governance

Stakeholder collaboration

Data modeling

Tools

Azure Data Factory

Terraform

Power BI

Job description

Role & responsibilities

• Lead architecture and design discussions for new data and analytics use cases
• Design scalable Lakehouse architecture using Azure Databricks and Azure Data Lake Storage Gen2
• Define data ingestion transformation orchestration and consumption frameworks
• Architect batch and realtime data processing solutions
• Develop data models supporting reporting analytics AIML and business intelligence requirements
• Establish enterprise data governance security and monitoring standards
• Collaborate with business stakeholders to translate business requirements into technical solutions
• Drive performance optimization cost optimization and platform scalability initiatives
• Define CICD DevOps and Infrastructure as Code standards for data platforms
• Mentor data engineers and provide technical leadership across delivery teams
• Support effort estimation technical roadmap creation and solution

Preferred candidate profile

Databricks ML (Lead Position)

Candidate having lead experince and ready to work on indiviually on coding