Data Engineer: AI-Driven Pipelines & RAG Solutions

G42; Abu Dhabi; On-site; AED 220,000 - 320,000; Full time

Benefits offered by this job

Healthcare

Education support

Leave benefits

Job summary

Inception42, a G42 company, seeks a Data Engineer to build scalable data pipelines and AI solutions using Azure Agent Foundry, OpenAI services, LangChain, and Databricks. You will design enterprise-grade data architectures and collaborate with data scientists to deliver intelligent features.

The ideal candidate has strong data engineering foundations and hands-on cloud experience to deploy AI systems at scale across industries.

Qualifications

• Bachelor’s degree in a relevant field.
• 3+ years experience in Data Engineering, AI/ML engineering roles.

Responsibilities

• Develop and deploy AI agents and data pipelines.
• Design scalable data architectures and ETL/ELT workflows.
• Ensure data quality, governance, and security across systems.
• Collaborate with data scientists and product teams to deliver AI features.
• Support MLOps and DevOps processes including CI/CD and containerized deployments.

Skills

Python

SQL

PySpark

ML/AI frameworks

LLMOps

RAG systems

vector databases

REST APIs

GraphQL APIs

Kafka

Docker/Kubernetes

Education

Bachelor's in Computer Science, Engineering, Data Science, or related field

Tools

Azure Databricks

Azure Agent Foundry

OpenAI APIs

LangChain

Databricks

Docker

Kubernetes

Kafka

RabbitMQ

Job description

Inception42, a G42 company, seeks a Data Engineer to build scalable data pipelines and AI solutions using Azure Agent Foundry, OpenAI services, LangChain, and Databricks. You will design enterprise-grade data architectures and collaborate with data scientists to deliver intelligent features.

The ideal candidate has strong data engineering foundations and hands-on cloud experience to deploy AI systems at scale across industries.