AI Data Engineer: Scale Data Pipelines for AI

Caliberly; Dubai; On-site; AED 279,000 - 335,000; Full time

Benefits offered by this job

Visa processing

Medical insurance

Flight tickets

Accommodation support

Meal allowances

Visa processing assistance

MacBook and iPhone

Job summary

Caliberly in Dubai is seeking an AI Data Engineer to design, build, and maintain scalable data pipelines powering our AI/ML solutions. You will collaborate with data scientists, ML engineers, and software developers to ensure the seamless flow, transformation, and integrity of data for AI applications.

The role requires 5 years in data engineering, strong Python/Scala/Java, cloud platforms, and experience with Spark/Kafka.

Qualifications

• Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
• 5 years of experience in data engineering, preferably with exposure to AI/ML workflows.
• Proficiency in Python, Scala, or Java, and strong SQL/NoSQL skills.
• Experience with cloud platforms (AWS/Azure/GCP) and data orchestration tools (Airflow/Prefect).
• Knowledge of data lakehouse architectures and MLOps is a plus.

Responsibilities

• Design, build, and manage scalable data pipelines for AI/ML systems.
• Collaborate with AI/ML teams to understand data requirements and deliver high-quality datasets.
• Optimize data storage and retrieval for low-latency AI workloads.
• Implement ETL/ELT processes using modern data engineering tools and cloud platforms.
• Ensure data quality, governance, and security across platforms.
• Integrate structured and unstructured data from APIs, databases, and streaming platforms.
• Work with Spark, Hadoop, Kafka and other big data technologies.
• Monitor pipelines and automate error handling and recovery.
• Contribute to deploying AI/ML models in production environments.
• Document data processes, schemas, and infrastructure.

Skills

Python

Scala

Java

SQL

NoSQL

Data pipelines

Education

Bachelor's or Master's in Computer Science/Data Engineering

Tools

AWS

Azure

GCP

Apache Airflow

Prefect

Spark

Hadoop

Kafka

Docker

Job description

Caliberly in Dubai is seeking an AI Data Engineer to design, build, and maintain scalable data pipelines powering our AI/ML solutions. You will collaborate with data scientists, ML engineers, and software developers to ensure the seamless flow, transformation, and integrity of data for AI applications.

The role requires 5 years in data engineering, strong Python/Scala/Java, cloud platforms, and experience with Spark/Kafka.