Senior Data Engineer: Secure Data Lakehouse Architect

TALENTMATE; Abu Dhabi; On-site; AED 180,000 - 300,000; Full time

Job summary

TALENTMATE is seeking a Senior Data Engineer in Abu Dhabi to design core data infrastructure for AI-driven transformation. You will build defense-grade Data Lakehouse architectures, ensuring a single source of truth for AI systems, and lead Workstream 1—Data & Platform Foundations—integrating SAP S/4HANA, Ariba, and unstructured data for high-security analytics.

You will develop high-performance pipelines, enable Retrieval-Augmented Generation tools, and ensure data lineage and governance within

Qualifications

• 5+ years of experience in Data Engineering
• Experience building pipelines for ML/Generative AI in enterprise
• Proficiency with Python, SQL, Spark, Kafka, Airflow

Responsibilities

• Design defense-grade Data Lakehouse architectures as the Single Source of Truth for AI-driven Supply Chain Intelligence.
• Lead the Workstream 1: Data & Platform Foundations and integrate SAP S/4HANA, Ariba, and unstructured data.
• Architect ingestion pipelines from ERP systems ensuring near real-time availability for forecasting models and AI agents.
• Build connectors for external feeds to enrich data with macro signals for AI applications.
• Implement RBAC, audit logging, and data redaction policies for compliance with on-premise security.

Skills

Python

SQL

Data engineering concepts

Team collaboration

Tools

Apache Spark

Kafka

Airflow

Databricks/Delta Lake

Weaviate

Milvus

dbt

Dagster

Prefect

Docker

Kubernetes

RBAC

Job description

TALENTMATE is seeking a Senior Data Engineer in Abu Dhabi to design core data infrastructure for AI-driven transformation. You will build defense-grade Data Lakehouse architectures, ensuring a single source of truth for AI systems, and lead Workstream 1—Data & Platform Foundations—integrating SAP S/4HANA, Ariba, and unstructured data for high-security analytics.

You will develop high-performance pipelines, enable Retrieval-Augmented Generation tools, and ensure data lineage and governance within