Data Engineer - AI & Analytics Platform (Abu Dhabi)

CNTXT AI; Abu Dhabi; In loco; AED 279.000 - 469.000; Tempo pieno

Descrizione del lavoro

CNTXT AI is seeking a Data Engineer to design, build, and maintain scalable data infrastructure powering analytics, AI, and ML products. You will design robust data pipelines, integrate data from multiple sources, and ensure data quality for enterprise consumption.

The role involves collaborating with data scientists, ML engineers, product teams, and software engineers to transform raw data into business value and to implement CI/CD for data workflows, while staying current with cloud data

Competenze

• Bachelor's degree in Computer Science, Software Engineering, Information Systems, or a related field.
• 4+ years of experience in Data Engineering or Backend/Data Platform development.
• Strong proficiency in Python and SQL.
• Experience building ETL/ELT pipelines using modern orchestration tools such as Airflow, Prefect, or Dagster.
• Strong knowledge of relational and NoSQL databases including PostgreSQL, MySQL, MongoDB, or Cassandra.
• Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.

Mansioni

• Design, develop, and maintain scalable ETL/ELT pipelines for structured and unstructured data.
• Build and manage modern data warehouses and data lakes.
• Develop reliable batch and real-time data processing pipelines.
• Integrate data from APIs, databases, third-party platforms, and cloud services.
• Ensure high standards of data quality, integrity, security, and governance.
• Optimize data models and database performance for analytics and reporting.
• Monitor, troubleshoot, and improve data pipeline reliability and performance.
• Collaborate with Data Scientists, ML Engineers, Product Managers, and Software Engineers to deliver data solutions.
• Implement CI/CD practices and infrastructure automation for data workflows.
• Document data architecture, pipeline designs, and engineering best practices.
• Stay current with emerging technologies in cloud data engineering and big data ecosystems.

Conoscenze

Python

SQL

Airflow

Dagster

Prefect

Docker

Kubernetes

Kafka

BigQuery

Snowflake

Formazione

Bachelor's degree in CS/Engineering/IS

Strumenti

PostgreSQL

MySQL

MongoDB

Snowflake

BigQuery

Redshift

Azure

AWS

GCP

Airflow

Descrizione del lavoro

CNTXT AI is seeking a Data Engineer to design, build, and maintain scalable data infrastructure powering analytics, AI, and ML products. You will design robust data pipelines, integrate data from multiple sources, and ensure data quality for enterprise consumption.

The role involves collaborating with data scientists, ML engineers, product teams, and software engineers to transform raw data into business value and to implement CI/CD for data workflows, while staying current with cloud data