Data Engineer - Real-Time ETL & Cloud Pipelines

Snoonu; Qatar; Remote; QAR 180,000 - 300,000; Full time

Benefits offered by this job

Global Vibes

Flexible Time Off

Learning budget

Job summary

Snoonu in Qatar is seeking an experienced data engineer to enhance day-to-day ETL activities, integrating new sources and extending batch and streaming pipelines across a modern data stack. This role focuses on building real-time pipelines with infrastructure-as-code, supporting BI data quality, and enabling data extraction for downstream systems.

We value Python, open-source tools like dbt and Airflow, and a stack including Databricks, PySpark, SQL, GCP, AWS, and BigQuery to drive scalable

Qualifications

• Programming skills with multiple languages or Python frameworks.
• Experience with open-source tools such as dbt and Airflow.
• Strong SQL skills including subqueries, window functions and CTEs.
• Knowledge of Databricks, delta tables and PySpark.
• Familiarity with infrastructure as code (e.g., AWS CloudFormation).

Responsibilities

• Integrating new sources using the existing batch and streaming ETL system.
• Creating real-time pipelines using an infrastructure-as-code approach.
• Supporting the BI team by investigating data quality issues.
• Helping teams extract data from the warehouse into their systems.
• Participating in ETL system migrations for scalability and performance.

Skills

Python

ETL understanding

SQL

Data modeling

Tools

dbt

Airflow

Databricks

PySpark

AWS CloudFormation

Job description

Snoonu in Qatar is seeking an experienced data engineer to enhance day-to-day ETL activities, integrating new sources and extending batch and streaming pipelines across a modern data stack. This role focuses on building real-time pipelines with infrastructure-as-code, supporting BI data quality, and enabling data extraction for downstream systems.

We value Python, open-source tools like dbt and Airflow, and a stack including Databricks, PySpark, SQL, GCP, AWS, and BigQuery to drive scalable