Senior Data Engineer at Better Solutions FZ LLC

Better Solutions FZ LLC; Dubai; On-site; AED 85,000 - 115,000; Full time

Job summary

Better Solutions FZ LLC in Dubai, UAE is seeking a Senior Data Engineer to design and maintain scalable ETL/ELT pipelines and data solutions on-site.

The role emphasizes hands-on experience with Microsoft Fabric, Azure Data Factory, Synapse, and data lakes, plus streaming with Kafka and Airflow, to deliver reliable data assets for analytics and ML workflows.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field.
• 4-5 years of professional experience in data engineering.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines for ingesting and transforming structured and unstructured data.
• Work with Microsoft Fabric to build dataflows, lakehouses, and end-to-end data solutions.
• Develop and optimize data storage solutions using Azure Data Lake Storage, Azure Synapse, and Azure SQL Database.
• Implement streaming and batch processing using Apache Spark, Azure Stream Analytics, and Kafka.
• Collaborate with data architects to implement data models, governance, and security standards.
• Schedule and orchestrate pipelines using Azure Data Factory or Apache Airflow.
• Ensure data quality, integrity, and availability through validation, monitoring, and error-handling frameworks.
• Support advanced analytics and machine learning by delivering clean, curated, and well-documented datasets.
• Work with stakeholders to understand business needs and deliver data solutions aligned with objectives.

Skills

Python

SQL

PySpark/Spark

Education

Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field

Tools

Microsoft Fabric

Azure Data Factory

Azure Synapse Analytics

Azure SQL Database

Azure Data Lake Storage

Databricks

Hadoop ecosystem

Kafka

Azure Event Hubs

Airflow

dbt

Power BI

GitHub Actions

Azure DevOps

Job description

Senior Data Engineer at Better Solutions FZ LLC in Dubai, DU, AE.

Full time on site position offers great opportunities for career growth.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines for ingesting and transforming structured and unstructured data.
• Work with Microsoft Fabric to build dataflows, lakehouses, and end-to-end data solutions.
• Develop and optimize data storage solutions using Azure Data Lake Storage, Azure Synapse, and Azure SQL Database.
• Implement streaming and batch processing using tools like Apache Spark, Azure Stream Analytics, and Kafka.
• Collaborate with data architects to implement data models, governance, and security standards.
• Schedule and orchestrate pipelines using Azure Data Factory or Apache Airflow.
• Ensure data quality, integrity, and availability through validation, monitoring, and error-handling frameworks.
• Support advanced analytics and machine learning by delivering clean, curated, and well-documented datasets.
• Work with stakeholders to understand business needs and deliver data solutions aligned with objectives.

Required Skills & Experience

• Strong programming skills in Python, SQL, and familiarity with PySpark/Spark.
• Hands-on experience with Microsoft Fabric (dataflows, lakehouses, pipelines, Synapse integration).
• Proficiency in Azure data services: Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, Azure Data Lake Storage.
• Knowledge of big data frameworks (Spark, Databricks, Hadoop ecosystem).
• Experience with data streaming technologies such as Kafka or Azure Event Hubs.
• Solid understanding of data modeling, warehousing, and performance optimization.
• Familiarity with cloud architecture and security best practices in Azure.
• Experience with orchestration & workflow automation tools (Airflow, Data Factory pipelines).
• Strong problem-solving and collaboration skills with both technical and non-technical teams.
• Nice to Have: Experience with dbt for transformations.
• Familiarity with Power BI for enabling analytics.
• Understanding of CI/CD for data pipelines (e.g., GitHub Actions, Azure DevOps).
• Exposure to machine learning workflows and MLOps.

Education & Background

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field.
• 4-5 years of professional experience in data engineering.

Job Details

• Job Type: Full-time
• Pay: AED100,000.00 per year
• Experience: Data engineering : 4 years (Required)
• Location: Dubai (Required)
• Work Location: In person