AI / Data Engineer

TATWEER MIDDLE EAST AND AFRICA L.L.C; Abu Dhabi; On-site; AED 120,000 - 180,000; Full time

Job summary

A leading company in the UAE seeks a Data Engineer to build reliable ingestion pipelines and manage large datasets. The role involves implementing monitoring dashboards and requires strong skills in Python and SQL. Candidates should be familiar with ETL tools and data versioning techniques.

Qualifications

• Strong Python and SQL skills required.
• Experience with ETL tools and data versioning preferred.
• Familiarity with handling large datasets is essential.

Responsibilities

• Build reliable ingestion pipelines for data.
• Manage and version datasets for training reproducibility.
• Implement monitoring dashboards for data management.

Skills

Python

SQL

ETL tools

Data versioning

Handling large datasets

Tokenization

Dataset curation

Vector storage

Chunking

Prompt design

Tools

Airflow

dbt

DVC

LakeFS

Prometheus

Grafana

Kibana

Job description

Job Description

• Build reliable ingestion pipelines
• Clean, transform, and store training/fine-tuning datasets
• Manage high-volume storage efficiently (object storage like MinIO or NFS for fine-tuning datasets)
  
  

Work Locations

UAE - Abu Dhabi

Responsibilities

• Version datasets for training reproducibility
• Implement monitoring dashboards (Prometheus/Grafana/Kibana)
  
  

Skills + Experience

• Strong Python/SQL skills
• ETL tools (Airflow, dbt optional)
• Data versioning (DVC or LakeFS optional)
• Basic familiarity with handling large datasets
• Tokenization, dataset curation
• Vector storage (e.g., FAISS)
• Chunking
• Prompt design
  
  

Apply Online