Senior Azure Data Engineer — Platform & Analytics

NorthBay Solutions LLC; Abu Dhabi; On-site; AED 240,000 - 480,000; Full time

Job summary

NorthBay Solutions LLC is seeking an experienced Senior Data Engineer to design, develop, and manage modern data platforms and cloud-based analytics solutions on Microsoft Azure.

The role requires 6–10 years of data engineering experience, strong Azure Data Services expertise, and hands-on development of ETL/ELT pipelines. Onsite in Abu Dhabi, UAE, with a focus on enterprise data platforms and AI/ML readiness.

Qualifications

• Bachelor's degree in computer science, information technology, or related field.
• 6–10 years of professional data engineering experience.
• Strong hands-on experience with Microsoft Azure Data Services.
• Experience with Azure Data Factory, Synapse, ADLS Gen2, and Azure SQL Database.
• Designing, developing, and maintaining large-scale ETL/ELT pipelines.
• Proficiency in SQL and query performance tuning.
• Hands-on PySpark and distributed processing.
• Strong Python programming; Scala/Java a plus.
• Knowledge of data warehousing, lakehouse architectures, and data governance.

Responsibilities

• Design, develop, and maintain scalable data platforms and pipelines on Azure.
• Build batch and real-time data ingestion for various data sources.
• Create data lake, data warehouse, and lakehouse solutions for analytics.
• Develop and optimize ETL/ELT pipelines using cloud-native practices.
• Implement data transformation, cleansing, and quality checks.
• Collaborate with stakeholders and analytics teams to translate requirements.
• Optimize storage, processing, and query performance across platforms.
• Enforce data security, governance, and metadata management.

Skills

Azure Data Services

Azure Data Factory

Azure Synapse

Azure Data Lake

Python

SQL

PySpark

Data Warehousing

ETL/ELT

Data Governance

Git

CI/CD

Education

Bachelor’s degree in CS/IT

Tools

Databricks

Delta Lake

Power BI

Kafka

Azure Event Hubs

Job description

NorthBay Solutions LLC is seeking an experienced Senior Data Engineer to design, develop, and manage modern data platforms and cloud-based analytics solutions on Microsoft Azure.

The role requires 6–10 years of data engineering experience, strong Azure Data Services expertise, and hands-on development of ETL/ELT pipelines. Onsite in Abu Dhabi, UAE, with a focus on enterprise data platforms and AI/ML readiness.