Senior Data Engineer – Azure Cloud & Data Platforms | CNS Middle East | Abu Dhabi

CNS Middle East; Abu Dhabi; On-site; AED 300,000 - 600,000; Full time

Job summary

CNS Middle East is seeking a Senior Data Engineer in Abu Dhabi to own enterprise-scale data pipelines and cloud migrations. You will design and optimize EDW and data lakehouse architectures, migrating on-prem ETL to Azure using ADF, Databricks, Synapse, and Fabric.

You will implement data models, quality checks, and governance while collaborating with cross-functional teams in an Agile setting. Immediate on-site joining is preferred.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Software Engineering, Data Engineering, or a related technical discipline.

Responsibilities

• Design, develop, test, optimize, and maintain scalable ETL and ELT data pipelines for Enterprise Data Warehouses (EDW) and Data Lakehouses.
• Execute seamless migration of legacy on-premises ETL workflows to Azure Cloud utilizing ADF, Databricks, Synapse, and Microsoft Fabric.
• Develop and optimize enterprise-scale data architectures and data processing solutions across hybrid cloud and on-premises environments.
• Design and implement robust data models, dimensional schemas, and data marts to support business intelligence and reporting requirements.
• Build and manage high-performance data processing workflows utilizing SQL, T-SQL, Python, Java, Scala, and Apache Spark.
• Implement rigorous data quality checks, data validation protocols, and end-to-end data integrity controls.
• Ensure strict data security, compliance, and governance standards in collaboration with enterprise Data Governance teams.
• Monitor, troubleshoot, and optimize data pipelines and big data platforms utilizing Kafka, Hadoop, and Denodo.

Skills

Azure Data Factory

Databricks

Synapse

Microsoft Fabric

PySpark

SQL

T-SQL

Python

Java

Scala

Apache Spark

Education

Bachelor’s or Master’s degree in Computer Science, Software Engineering, Data Engineering

Tools

Kafka

Hadoop

Denodo

CI/CD (GitHub Actions)

Docker

Kubernetes

Job description

Position Summary

CNS Middle East is actively seeking an experienced, high-caliber, and technical Senior Data Engineer specializing in Azure Cloud and Data Platforms with a minimum of 5+ years of progressive professional experience in big data engineering, ETL pipeline development, and enterprise data warehousing to join our client engineering team on a full-time permanent on-site basis in Abu Dhabi (immediate joiners preferred). In this critical data architecture and cloud migration role, you will be responsible for migrating on-premises workflows to Azure Cloud, designing scalable ETL pipelines, and optimizing enterprise data lakehouse architectures. You will leverage your deep specialist expertise in Azure Data Factory, Databricks, Synapse, Microsoft Fabric, PySpark, and SQL to deliver uncompromised data reliability, high analytical throughput, and operational excellence. This opportunity offers competitive compensation, executive technical visibility, and exceptional career growth prospects within a premier global technology consulting and systems integration enterprise.

Detailed Job Description

As a Senior Data Engineer supporting CNS Middle East in Abu Dhabi, you will take full operational, tactical, and technical ownership of enterprise-scale data engineering, ETL migration, data modeling, and performance optimization across mission-critical cloud and on-premises environments. Your day-to-day responsibilities include designing, developing, and maintaining scalable ETL and ELT pipelines for enterprise data warehouses (EDW) and cloud data lakehouses, executing seamless migrations of legacy on-premises ETL workflows to Azure Cloud utilizing Azure Data Factory (ADF), Databricks, Azure Synapse Analytics, and Microsoft Fabric, developing and optimizing enterprise data architectures across hybrid environments, designing and implementing robust data models to support complex business intelligence, reporting, and analytics requirements, building and managing high-performance data processing solutions using SQL, T-SQL, Python, Java, Scala, and Apache Spark, implementing rigorous data quality checks, data validation frameworks, and end-to-end data integrity controls, ensuring strict data security, compliance, and governance standards in active collaboration with internal Data Governance teams, monitoring, troubleshooting, and optimizing data pipelines and big data platform performance utilizing technologies such as Kafka, Hadoop, and Denodo, collaborating closely with cross-functional software engineering, analytics, and executive stakeholder squads in Agile sprint cycles, preparing comprehensive technical documentation of data schemas, pipeline topologies, and operational runbooks, and ensuring strict compliance with the 5+ years experience requirement and Abu Dhabi on-site presence. You will utilize your proactive troubleshooting and analytical problem-solving skills to resolve complex data pipeline bottlenecks and latency anomalies under strict service level agreements.

Key Responsibilities

• Design, develop, test, optimize, and maintain scalable ETL and ELT data pipelines for Enterprise Data Warehouses (EDW) and Data Lakehouses.
• Execute seamless migration of legacy on-premises ETL workflows to Azure Cloud utilizing ADF, Databricks, Synapse, and Microsoft Fabric.
• Develop and optimize enterprise-scale data architectures and data processing solutions across hybrid cloud and on-premises environments.
• Design and implement robust data models, dimensional schemas, and data marts to support business intelligence and reporting requirements.
• Build and manage high-performance data processing workflows utilizing SQL, T-SQL, Python, Java, Scala, and Apache Spark.
• Implement rigorous data quality checks, data validation protocols, and end-to-end data integrity controls.
• Ensure strict data security, compliance, and governance standards in collaboration with enterprise Data Governance teams.
• Monitor, troubleshoot, and optimize data pipelines and big data platforms utilizing Kafka, Hadoop, and Denodo.

Required Qualifications & Skills

• Bachelor’s or Master’s degree in Computer Science, Software Engineering, Data Engineering, or a related technical discipline.
• Minimum of 5+ years of progressive professional experience in big data engineering, data warehousing, and cloud analytics.
• Strong, demonstrable hands-on professional expertise in Microsoft Azure cloud data services (ADF, Databricks, Synapse, Microsoft Fabric).
• Comprehensive working knowledge and practical proficiency in SQL, T-SQL, Python, Java, Scala, and Apache Spark.
• Deep practical experience designing and developing Enterprise Data Warehouses (EDW) and cloud data lakehouses.
• Solid practical experience in ETL pipeline migration, data quality validation, and performance optimization.
• Exceptional analytical, troubleshooting, debugging, and problem-solving capabilities under high-pressure conditions.
• Excellent written and verbal English communication skills with strong cross-functional stakeholder collaboration abilities.
• Mandatory legal work eligibility and physical availability for full-time on-site professional operations in Abu Dhabi (immediate joiners preferred).

Nice-to-Have Skills

• Professional certifications such as Microsoft Certified: Azure Data Engineer Associate or Databricks Certified Professional Data Engineer.
• Prior professional working experience in top-tier technology consulting firms, systems integrators, or enterprise IT organizations in the Middle East.
• Hands-on familiarity with enterprise streaming and big data platforms including Apache Kafka, Apache Hadoop, and Denodo data virtualization.
• Experience utilizing CI/CD deployment pipelines, GitHub Actions, and containerization platforms (Docker, Kubernetes).
• Exposure to agile software development methodologies and enterprise IT service management (ITSM) ticketing platforms (ServiceNow, Jira).

Salary and Employment Details

• Salary: Market Competitive / Enterprise Cloud Package
• Deadline: Open until filled (Urgent Abu Dhabi Senior Data Engineer Opening)
• Notice Period: Immediate Joiners Preferred
• Contract Duration: Permanent / Full-Time On-Site Engagement (Abu Dhabi)

Recruitment Pro Tip

When applying for this Senior Data Engineer position through CNS Middle East, ensure your resume explicitly highlights your Azure cloud data stack (ADF, Databricks, Synapse) and big data programming portfolio (Python, Spark, SQL), details your experience in EDW and data lakehouse architecture, and confirms your availability as an immediate joiner in Abu Dhabi.