AI Data Architect: Databricks & Pipelines Expert

Discovered MENA; Abu Dhabi; On-site; AED 300,000 - 420,000; Full time

Job summary

Discovered MENA is seeking an experienced Data Architect for a leading financial services organization in Abu Dhabi. You will design and implement scalable data architectures and pipelines supporting both operational and analytical use cases in a fast-moving environment.

You will collaborate with software and AI/ML teams to ensure data governance, security, quality and metadata documentation, while continuously improving pipelines and enabling enterprise-scale analytics.

Qualifications

• 5+ years of experience in data engineering or data architecture.
• Significant and proven Databricks experience and AI use cases.
• Experience building and operating automated data pipelines with Airflow, dbt and related tools.
• Strong understanding of big data architectures and pipeline performance optimization.
• Advanced SQL skills for data manipulation and querying.
• Proficiency in Python and at least one other language (Scala/Java).
• Hands-on experience with cloud-based data platforms.
• Strong analytical and communication skills.

Responsibilities

• Design, implement, and maintain scalable ETL/ELT pipelines ingesting data from diverse sources.
• Collaborate with software engineering and AI/ML teams to ensure governance, security and quality.
• Document data architectures, lineage, and metadata for transparency and scalability.

Skills

Databricks

Airflow

dbt

SQL

Python

Scala/Java

Cloud platforms

Data governance

Problem solving

Communication

Education

Bachelor's degree in CS/Engineering/related

Tools

Databricks

Airflow

dbt

Job description

Discovered MENA is seeking an experienced Data Architect for a leading financial services organization in Abu Dhabi. You will design and implement scalable data architectures and pipelines supporting both operational and analytical use cases in a fast-moving environment.

You will collaborate with software and AI/ML teams to ensure data governance, security, quality and metadata documentation, while continuously improving pipelines and enabling enterprise-scale analytics.