Data Engineer: Real-Time ETL & Cloud Pipelines

سنونو; Doha; On-site; QAR 180,000 - 240,000; Full time

Benefits offered by this job

Global Vibes

Brain Boosters

Builder’s Playground

Flexible Time Off

Agile Everything

Job summary

Snoonu is seeking an experienced data engineer to help with day-to-day activities, including integrating new sources and extending our ETL infrastructure. The role covers batch and streaming pipelines, a data lake and data warehouse, and infrastructure-as-code tooling to support a growing DE team.

You will work with Python, SQL, Airflow, dbt, Spark, PySpark, and cloud services (AWS). Experience with Databricks, BigQuery, and BI tools like Tableau/Redash is a plus.

Qualifications

• Experience with batch and streaming ETL systems.
• Knowledge of data pipelines, data lakes and data warehouses.
• Familiarity with infrastructure as code and cloud platforms.

Responsibilities

• Integrating new sources using the existing batch and streaming ETL system.
• Creating new real-time pipelines using an infrastructure-as-code approach.
• Supporting the BI team by investigating data quality issues.
• Assisting teams in extracting data from the warehouse into their systems.
• Participating in ETL system migrations to ensure scalable design.

Skills

Python

SQL

Airflow

dbt

Spark

PySpark

AWS

Tools

Databricks

BigQuery

Tableau

Redash

CloudFormation

Job description

Snoonu is seeking an experienced data engineer to help with day-to-day activities, including integrating new sources and extending our ETL infrastructure. The role covers batch and streaming pipelines, a data lake and data warehouse, and infrastructure-as-code tooling to support a growing DE team.

You will work with Python, SQL, Airflow, dbt, Spark, PySpark, and cloud services (AWS). Experience with Databricks, BigQuery, and BI tools like Tableau/Redash is a plus.