Data Engineer

INCEPTION ARTIFICIAL INTELLIGENCE L.L.C - O.P.C; Abu Dhabi; On-site; AED 250,000 - 380,000; Full time

Benefits offered by this job

Healthcare

Education support

Leave benefits

Job summary

Inception42 in Abu Dhabi is seeking a Data Engineer to build scalable data pipelines and develop AI solutions using Azure Agent Foundry, OpenAI, LangChain, and Databricks. You will design ETL/ELT workflows, ensure data quality, and collaborate with data scientists and product teams to deliver intelligent features.

The role emphasizes MLOps, DevOps integration, and containerized deployments in a cloud-first environment across enterprise-scale AI systems.

Qualifications

• Bachelor’s degree in CS/engineering/data science or related field.
• 3+ years in Data/AI/Data Engineering or ML Engineering roles.
• Experience delivering scalable AI/data solutions in cloud environments (Azure preferred).
• Strong proficiency in Python, SQL, PySpark, and ML/AI frameworks.

Responsibilities

• Develop and deploy AI agents using Azure Foundry, OpenAI, LangChain, and N8N.
• Build RAG pipelines, embeddings, vector DB integrations, and knowledge graphs.
• Design and maintain scalable data pipelines, ETL/ELT workflows, and data architectures.
• Build and maintain APIs and data services supporting AI/analytics workloads; optimize ML workflows on Azure Databricks and integrate with Azure Fabric.
• Ensure data quality, reliability, governance, and compliance across systems.
• Collaborate with data scientists, ML engineers, and product teams to deliver intelligent features.
• Support MLOps and DevOps processes including CI/CD, model lifecycle management, and containerized deployments.

Skills

Python

SQL

PySpark

LLMOps

Data Modeling

ETL

Problem-Solving

Communication

Education

Bachelor’s in Computer Science, Engineering, Data Science

Tools

Azure Agent Foundry

OpenAI APIs

LangChain

N8N

Azure Databricks

Azure Cloud Services

Spark

Hadoop

Flink

REST/GraphQL APIs

Docker

Kubernetes

Vector Databases

Job description

Job Description:

Inception42, a G42 company, is the region’s leading innovator of AI-powered domain-specific as well as industry-agnostic products, built on a rich heritage of research and development. Within the G42 ecosystem, Inception42 functions as the core intelligence layer – transforming data and compute infrastructure into real-world, applied AI solutions. Beyond its commercial endeavors, Inception42 is committed to creating positive societal impact. For more information, please visit www.inception42.ai

Overview:

Abu Dhabi

Inception42, a G42 company, is the region’s leading innovator of AI-powered domain-specific as well as industry-agnostic products, built on a rich heritage of research and development. Within the G42 ecosystem, Inception42 functions as the core intelligence layer – transforming data and compute infrastructure into real-world, applied AI solutions. Beyond its commercial endeavors, Inception42 is committed to creating positive societal impact. For more information, please visit www.inceptionai.ai

Overview

We are looking for a Data Engineer who can build scalable data pipelines while also developing intelligent AI solutions using Azure Agent Foundry, OpenAI services, LangChain, Databricks, and modern cloud architectures. The ideal candidate has strong data engineering foundations combined with hands‑on experience designing and deploying enterprise‑grade AI systems.

Responsibilities:

What You’ll Own

• Develop and deploy AI agents using Azure Agent Foundry, OpenAI, LangChain, and N8N.
• BuildRAG pipelines, embeddings, vector database integrations, and knowledge graph solutions.
• Design and maintain scalabledata pipelines,ETL/ELTworkflows, and data architectures.
• Build and maintainAPIs and data services supporting AI and analytics workloads.Optimize ML workflows on AzureDatabricksand integrate with Azure Fabric.
• Ensure data quality, reliability, governance, and compliance across all systems.
• Collaborate with data scientists, ML engineers, and product teams to deliver intelligent features.
• SupportMLOpsandDevOpsprocesses including CI/CD, model lifecycle management, and containerized deployments.

Qualifications:

What We’re Looking For

• Bachelor’s in Computer Science, Engineering, Data Science, or related field.
• 3+ years experience in Data Engineering, AI Engineering, or ML Engineering roles.
• Experience delivering scalable AI/data solutions in cloud environments (Azure preferred).
• Strong proficiency in Python, SQL, PySpark, and ML/AI frameworks.
• Experience with Azure Agent Foundry, OpenAI APIs, LLMOps, RAG systems, and vector databases.
• Hands‑on experience with Azure Databricks, Azure cloud services, and data platforms.Knowledge of big data tools (Spark, Hadoop, Flink) and modern data storage (SQL, NoSQL).
• Experience with REST/GraphQL APIs, Kafka/RabbitMQ, Docker/Kubernetes.
• Solid understanding of data modeling, ETL, and data quality best practices.Strong problem-solving, communication, and cross-functional collaboration skills.

Why Inception42

Inception42 is building AI systems designed for practical deployment at scale — across industries, infrastructure, and national‑level initiatives.

What We Look For

If you are a performance‑driven, inquisitive mind with the agility to adapt to ambiguity, you will fit right in. You should be eager to explore opportunities to build meaningful collaborations with stakeholders and aspire to create unique customer‑centric solutions. Bias for action and a passion to conquer new frontiers in the AI space is at the heart of the Inception42 community.

What Working At Inception42Offers

• Culture: An open, diverse and inclusive environment with a global vision that encourages personal growth and focuses on ground‑breaking, industry‑first innovations.
• Career: Outstanding learning, development & growth opportunities via structured training programs and innovative, high‑tech projects.
• Rewards: A competitive remuneration package with a host of perks including healthcare, education support, leave benefits and more.