Principal Software Engineer (Data Platform)

NorthBay - Pakistan; Islamabad; Hybrid; PKR 3,600,000 - 6,000,000; Full time

Job summary

NorthBay - Pakistan is seeking a Senior Azure Data Engineer with 5+ years of hands-on experience to design and develop scalable data solutions on Microsoft Azure.

You will design and implement ETL/ELT pipelines with ADF and Azure Databricks, build Data Lakehouse architectures on ADLS Gen2, and collaborate across Synapse, Event Hub, Logic Apps, and Azure SQL. The role requires UAE business hours compliance in a hybrid Pakistan-based setup.

Qualifications

• 5+ years of hands-on experience as a Senior Azure Data Engineer.
• Experience designing scalable data solutions on Microsoft Azure.
• Hybrid work setup in Pakistan.

Responsibilities

• Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks.
• Develop data transformation solutions using PySpark, Spark SQL, and Delta Lake.
• Build and maintain Data Lakehouse solutions using ADLS Gen2.
• Work with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL for data integration and processing.
• Implement secure integrations using Azure Key Vault and SharePoint.
• Troubleshoot and optimize data pipelines and Spark workloads.

Skills

ETL/ELT design

Tools

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Azure Event Hub

Azure Data Lake Storage Gen2

Azure Logic Apps

Azure Function Apps

Azure SQL Database

Azure Key Vault

SharePoint Integration

PySpark

Spark SQL

Delta Lake

Delta Tables

Data Lakehouse Architecture

Job description

Experience: 5+ Years

Location: Hybrid – Pakistan

Working Hours: UAE Business Hours

Job Summary

We are looking for a Senior Azure Data Engineer with 5+ years of hands-on experience in designing and developing scalable data solutions on Microsoft Azure.

Key Skills

• Azure Data Factory
• Azure Databricks
• Azure Synapse Analytics
• Azure Event Hub
• Azure Data Lake Storage Gen2
• Azure Logic Apps & Function Apps
• Azure SQL Database
• Azure Key Vault
• Microsoft SharePoint Integration
• PySpark & Spark SQL
• Delta Lake & Delta Tables
• Data Lakehouse Architecture

Responsibilities

• Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks.
• Develop data transformation solutions using PySpark, Spark SQL, and Delta Lake.
• Build and maintain Data Lakehouse solutions using ADLS Gen2.
• Work with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL for data integration and processing.
• Implement secure integrations using Azure Key Vault and SharePoint.
• Troubleshoot and optimize data pipelines and Spark workloads.

Note: Candidate must be comfortable working in UAE business hours and following the UAE public holiday calendar.