Senior Data Engineer

BBGC; Dubai; On-site; AED 180,000 - 250,000; Full time

Job summary

A global technology consultancy firm is seeking a Senior Data Engineer in Dubai. The role involves designing and maintaining data pipelines and analytics solutions using Azure and Databricks. Candidates should have over 6 years of experience in data engineering, with strong skills in Python and SQL. This position emphasizes collaboration with stakeholders to ensure data reliability and performance optimization.

Qualifications

• 6+ years of experience in data engineering or related roles.
• Proven expertise in Azure Data Factory and Azure Databricks.
• Strong proficiency in Python for data engineering tasks.

Responsibilities

• Design, build, and maintain scalable data pipelines and analytics solutions using Azure.
• Collaborate with business stakeholders to ensure data is accessible and reliable.

Skills

Data engineering

Azure Data Factory

Azure Databricks

Python

SQL

Real-time data processing

Problem-solving

Tools

Git

CI/CD pipelines

Job description

Overview

We are a global technology consultancy firm with offices in Middle East, Asia, Europe and USA. We deliver business benefits through innovation. We leverage cutting-edge technology led solutions delivered by a team of skilled professionals, from sustainable software development to cloud services and operational excellence strategy. We have extensive expertise in Capital Markets and in particular Trading and Risk Management functions.

Senior Data Engineer will play a critical role in designing, building, and maintaining scalable data pipelines and analytics solutions using Azure and Data bricks ecosystem. Collaborate closely with business stakeholders to ensure data is accessible, reliable, and optimized for performance.

Responsibilities

Senior Data Engineer will play a critical role in designing, building, and maintaining scalable data pipelines and analytics solutions using Azure and Data bricks ecosystem. Collaborate closely with business stakeholders to ensure data is accessible, reliable, and optimized for performance.

Qualifications

• 6+ years of experience in data engineering or related roles.
• Proven expertise in Azure Data Factory and Azure Databricks.
• Strong proficiency in Python for data engineering tasks.
• Solid understanding of SQL and relational databases.
• Exposure to real-time data processing frameworks (e.g., Spark Streaming, Kafka).
• Experience in maintaining and supporting production-grade data pipelines.
• Familiarity with trading business domain, including market data, trade lifecycle, and financial instruments.
• Experience with version control systems (e.g., Git) and CI/CD pipelines.
• Excellent problem-solving skills and attention to detail.