Data Engineer – AI NLP Pipelines (Dubai) | Flexible Hours

AYAN Labs; Dubai; On-site; AED 180,000 - 260,000; Full time

Job summary

AYAN Labs is seeking a data engineer to build and scale data pipelines that query multiple LLM APIs. You will model, store and version data, develop NLP processing, and ensure data quality for reliable product dashboards.

Experience with orchestration, cloud platforms and PostgreSQL is essential for success in this role. In this Dubai-based role, you will collaborate with founding team members to keep latency and costs in check while delivering robust data assets for customer-facing insights.

Qualifications

• Three years or more as a data engineer or in a similar role.
• Strong Python and SQL.
• Orchestration experience: Airflow, Dagster, Prefect or similar.
• Cloud (AWS, GCP or Azure) and Docker.
• PostgreSQL and solid data modelling.
• External APIs at volume: rate limits, retries, batching.
• Tests, version control, CI/CD. You document what you build.
• Real advantage: hands-on work with LLM APIs, NLP or embeddings, dbt or a warehouse, Arabic or French text processing.

Responsibilities

• Build and maintain pipelines that query multiple LLM APIs at volume.
• Model, store and version structured and unstructured data.
• Develop text processing: entity extraction, sentiment, citations and source attribution.
• Own data quality, monitoring and reproducibility of results.
• Keep API cost, latency and reliability under control.
• Expose clean data to the product and dashboards.

Skills

Python

SQL

Airflow

Dagster

Prefect

Cloud platforms

Docker

PostgreSQL

NLP

API integration

Tools

dbt

Git

CI/CD

Job description

AYAN Labs is seeking a data engineer to build and scale data pipelines that query multiple LLM APIs. You will model, store and version data, develop NLP processing, and ensure data quality for reliable product dashboards.

Experience with orchestration, cloud platforms and PostgreSQL is essential for success in this role. In this Dubai-based role, you will collaborate with founding team members to keep latency and costs in check while delivering robust data assets for customer-facing insights.