Principal Software Engineer (Data Platform)

NorthBay Solutions; Islamabad; Hybrid; PKR 3,000,000 - 5,200,000; Full time

Job summary

NorthBay Solutions in Pakistan is seeking a Senior Azure Data Engineer to design and develop scalable data solutions on Microsoft Azure. You will work on hybrid deployments aligning with UAE business hours and complex data pipelines.

The ideal candidate has 5+ years of hands-on experience with Azure Data Factory, Databricks, Synapse, Data Lakehouse architectures, and related services, delivering secure, efficient data integration across platforms.

Qualifications

• 5+ years of hands-on experience with Azure data services.
• Experience designing and developing scalable data solutions on Microsoft Azure.
• Comfortable with UAE business hours and hybrid work arrangements in Pakistan.

Responsibilities

• Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks.
• Develop data transformation solutions using PySpark, Spark SQL, and Delta Lake.
• Build and maintain Data Lakehouse solutions using ADLS Gen2.
• Work with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL for data integration.
• Implement secure integrations using Azure Key Vault and SharePoint.
• Troubleshoot and optimize data pipelines and Spark workloads.

Skills

ETL/ELT design

Data integration

Azure ecosystem understanding

Problem-solving

Tools

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Azure Event Hub

Azure Data Lake Storage Gen2

Azure Logic Apps

Azure Function Apps

Azure SQL Database

Azure Key Vault

SharePoint Integration

PySpark

Spark SQL

Delta Lake

Delta Tables

Data Lakehouse Architecture

Job description

Experience: 5+ Years
Location: Hybrid - Pakistan
Working Hours: UAE Business Hours

Job Summary

We are looking for a Senior Azure Data Engineer with 5+ years of hands-on experience in designing and developing scalable data solutions on Microsoft Azure.

Key Skills

• Azure Data Factory
• Azure Databricks
• Azure Synapse Analytics
• Azure Event Hub
• Azure Data Lake Storage Gen2
• Azure Logic Apps & Function Apps
• Azure SQL Database
• Azure Key Vault
• Microsoft SharePoint Integration
• PySpark & Spark SQL
• Delta Lake & Delta Tables
• Data Lakehouse Architecture

Responsibilities

• Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks.
• Develop data transformation solutions using PySpark, Spark SQL, and Delta Lake.
• Build and maintain Data Lakehouse solutions using ADLS Gen2.
• Work with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL for data integration and processing.
• Implement secure integrations using Azure Key Vault and SharePoint.
• Troubleshoot and optimize data pipelines and Spark workloads.

Note: Candidate must be comfortable working in UAE business hours and following the UAE public holiday calendar.