Senior Data Engineer - Real-Time ETL & Data Systems

Tanqeeb; Doha; On-site; QAR 180,000 - 300,000; Full time

Benefits offered by this job

Global team

Learning budget

Autonomy

Flexible time off

Agile environment

Job summary

Snoonu, Qatar’s homegrown Super App, seeks an engineer to manage and develop our ETL infrastructure including data lake, warehouse, and IaC tools. You will work on batch and real-time pipelines, data integration from various sources, and support data management improvements.

The role emphasizes programming and distributed systems, PySpark, Databricks, and cloud platforms (AWS/GCP). You’ll join a globally oriented team focused on performance, governance, and scalable data solutions.

Qualifications

• Strong programming skills, e.g., experience with several programming languages or Python frameworks.
• Software design skills - software design patterns, application design.
• Data system design or cloud systems experience (AWS, GCP, message brokers, object storage, query engines)
• Strong SQL skills, including the ability to apply subqueries, window functions, and CTEs
• Warehouse design or ETL systems design experience
• PySpark or other distributed systems knowledge, e.g., distributed computing, performance optimization
• Experience with or ability to use infrastructure as code, e.g., AWS CloudFormation
• Experience with or ability to use the Databricks platform

Responsibilities

• Integrating new sources using existing batch ETL system
• Creating new real-time pipelines using an infrastructure-as-code approach
• Supporting teams in extracting data from the warehouse into their systems, and working on Reverse ETL processes
• Taking part in data management process improvement, providing feedback about process changes, and proposing new solutions
• Automating processes and performing pipeline performance optimizations
• Taking responsibility for long-term improvement activities, refactoring, cost reduction investigations, and implementation

Skills

Programming

Software design

Data systems design

SQL

ETL systems

PySpark

Infrastructure as code

Databricks

Tools

AWS CloudFormation

Databricks

BigQuery

Tableau

Job description

Snoonu, Qatar’s homegrown Super App, seeks an engineer to manage and develop our ETL infrastructure including data lake, warehouse, and IaC tools. You will work on batch and real-time pipelines, data integration from various sources, and support data management improvements.

The role emphasizes programming and distributed systems, PySpark, Databricks, and cloud platforms (AWS/GCP). You’ll join a globally oriented team focused on performance, governance, and scalable data solutions.