Principal Software Engineer (Data Platform)

NorthBay Solutions LLC; Islamabad; On-site; PKR 2,500,000 - 4,500,000; Full time

Job summary

NorthBay Solutions LLC is seeking a Senior Azure Data Engineer in Pakistan. The role is hybrid-based, requiring 5+ years hands-on experience designing and developing scalable data solutions on Microsoft Azure.

You will design and implement ETL/ELT pipelines with ADF and Azure Databricks, build Data Lakehouse with ADLS Gen2, and collaborate across Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL. UAE business hours are observed.

Qualifications

• 5+ years hands-on experience designing and developing scalable data solutions on Microsoft Azure.
• Experience with hybrid cloud data architecture and data integration.
• Strong ETL/ELT development skills using Spark and PySpark.
• Knowledge of UAE business hours coordination is a plus.

Responsibilities

• Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks.
• Develop data transformation solutions using PySpark, Spark SQL, and Delta Lake.
• Build and maintain Data Lakehouse solutions using ADLS Gen2.
• Work with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL for data integration and processing.
• Implement secure integrations using Azure Key Vault and SharePoint.
• Troubleshoot and optimize data pipelines and Spark workloads.

Skills

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Azure Event Hub

Azure Data Lake Storage Gen2

Azure Logic Apps & Function Apps

Azure SQL Database

Azure Key Vault

Microsoft SharePoint Integration

PySpark & Spark SQL

Delta Lake & Delta Tables

Data Lakehouse Architecture

Job description

Experience: 5+ Years
Location: Hybrid – Pakistan
Working Hours: UAE Business Hours

Job Summary

We are looking for a Senior Azure Data Engineer with 5+ years of hands‑on experience in designing and developing scalable data solutions on Microsoft Azure.

Key Skills

• Azure Data Factory
• Azure Databricks
• Azure Synapse Analytics
• Azure Event Hub
• Azure Data Lake Storage Gen2
• Azure Logic Apps & Function Apps
• Azure SQL Database
• Azure Key Vault
• Microsoft SharePoint Integration
• PySpark & Spark SQL
• Delta Lake & Delta Tables
• Data Lakehouse Architecture

Responsibilities

• Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks.
• Develop data transformation solutions using PySpark, Spark SQL, and Delta Lake.
• Build and maintain Data Lakehouse solutions using ADLS Gen2.
• Work with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL for data integration and processing.
• Implement secure integrations using Azure Key Vault and SharePoint.
• Troubleshoot and optimize data pipelines and Spark workloads.

Note: Candidate must be comfortable working in UAE business hours and following the UAE public holiday calendar.