Data Engineer

AYAN Labs; Dubai; On-site; AED 180,000 - 260,000; Full time

Job summary

AYAN Labs is seeking a data engineer to build and scale data pipelines that query multiple LLM APIs. You will model, store and version data, develop NLP processing, and ensure data quality for reliable product dashboards.

Experience with orchestration, cloud platforms and PostgreSQL is essential for success in this role. In this Dubai-based role, you will collaborate with founding team members to keep latency and costs in check while delivering robust data assets for customer-facing insights.

Qualifications

• Three years or more as a data engineer or in a similar role.
• Strong Python and SQL.
• Orchestration experience: Airflow, Dagster, Prefect or similar.
• Cloud (AWS, GCP or Azure) and Docker.
• PostgreSQL and solid data modelling.
• External APIs at volume: rate limits, retries, batching.
• Tests, version control, CI/CD. You document what you build.
• Real advantage: hands-on work with LLM APIs, NLP or embeddings, dbt or a warehouse, Arabic or French text processing.

Responsibilities

• Build and maintain pipelines that query multiple LLM APIs at volume.
• Model, store and version structured and unstructured data.
• Develop text processing: entity extraction, sentiment, citations and source attribution.
• Own data quality, monitoring and reproducibility of results.
• Keep API cost, latency and reliability under control.
• Expose clean data to the product and dashboards.

Skills

Python

SQL

Airflow

Dagster

Prefect

Cloud platforms

Docker

PostgreSQL

NLP

API integration

Tools

dbt

Git

CI/CD

Job description

Founding team · Dubai, Founder HQ · Full time

Your customers ask ChatGPT, Gemini, Perplexity or Claude before they ever reach you, and what they hear is a second version of your brand you have never seen. AYAN reads how these models answer real buyer questions, shows a brand where it is recommended and where a competitor takes its place, and turns every gap into a fix that lands with the person or page that closes the sale.

Live clients in retail, beauty and hospitality across the Gulf.

Why this role exists

Every read we deliver starts with data: large volumes of model answers, collected across models, languages and markets, then turned into metrics a client trusts. You own that layer, so it is reliable, reproducible and ready to scale.

What you will do

• Build and maintain pipelines that query multiple LLM APIs at volume.
• Model, store and version structured and unstructured data.
• Develop text processing: entity extraction, sentiment, citations and source attribution.
• Own data quality, monitoring and reproducibility of results.
• Keep API cost, latency and reliability under control.
• Expose clean data to the product and dashboards.

Who you are

• Three years or more as a data engineer or in a similar role.
• Strong Python and SQL.
• Orchestration experience: Airflow, Dagster, Prefect or similar.
• Cloud (AWS, GCP or Azure) and Docker.
• PostgreSQL and solid data modelling.
• External APIs at volume: rate limits, retries, batching.
• Tests, version control, CI/CD. You document what you build.
• Real advantage: hands-on work with LLM APIs, NLP or embeddings, dbt or a warehouse, Arabic or French text processing.

Working with us

• Founders move fast and change their minds when the facts change. Flag it early or expect to be asked why you did not.
• Push back with reasons. Agreement is not a contribution.
• No ladder, no annual review. Results are how we measure. Attitude is why we hire.

Flexible hours, real time together at Founder HQ in Dubai. Dubai based.