Lead Data Engineer — AI-Ready Data Infrastructure Architect

Analytics Insight; Abu Dhabi; On-site; AED 180,000 - 220,000; Full time

Job summary

Analytics Insight is seeking a Lead Data Engineer in Abu Dhabi to build scalable data pipelines for AI applications. This role involves collaboration with AI engineers to develop reliable data infrastructure for vector search and RAG systems. Candidates should possess a bachelor's degree in computer science or engineering, with eight years of experience in data engineering and exceptional programming skills in Python and SQL. Experience with ETL workflows, NoSQL databases, and Kubernetes is also essential.

Qualifications

• Eight years of experience in data engineering and distributed systems.
• Experience creating and implementing RAG pipelines for AI systems.
• Practical knowledge of ETL pipeline development frameworks.

Responsibilities

• Design and optimize scalable data pipelines for advanced AI workloads.
• Develop ETL and ELT workflows for structured and unstructured data.
• Build vector database indexing and similarity search pipelines.

Skills

Python programming

SQL proficiency

NoSQL databases

Data modeling

ETL and ELT workflows

Kubernetes

Education

Bachelor’s degree in computer science or engineering

Tools

Vector databases

Graph databases

Job description

Analytics Insight is seeking a Lead Data Engineer in Abu Dhabi to build scalable data pipelines for AI applications. This role involves collaboration with AI engineers to develop reliable data infrastructure for vector search and RAG systems. Candidates should possess a bachelor's degree in computer science or engineering, with eight years of experience in data engineering and exceptional programming skills in Python and SQL. Experience with ETL workflows, NoSQL databases, and Kubernetes is also essential.