Principal Software Engineer Data Platform

NorthBay Solutions; Pakistan; Hybrid; PKR 900,000 - 1,300,000; Full time

Job summary

NorthBay Solutions is seeking a Senior Azure Data Engineer in a hybrid role based in Pakistan. The candidate will design and implement scalable data pipelines on Microsoft Azure, leveraging ADF, Databricks, and lakehouse architectures to support data-driven decisions.

The role requires 5+ years hands‑on experience with PySpark/Spark SQL, Delta Lake, and Azure data services, along with the ability to work UAE hours as applicable.

Qualifications

• 5+ years hands-on experience in designing scalable data solutions on Microsoft Azure.
• Experience with data lakehouse architectures and data engineering best practices.
• Familiarity with SharePoint integration and secure data workflows.

Responsibilities

• Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks.
• Develop data transformation solutions using PySpark, Spark SQL, and Delta Lake.
• Build and maintain Data Lakehouse solutions using ADLS Gen2.
• Work with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL for data integration and processing.
• Implement secure integrations using Azure Key Vault and SharePoint.
• Troubleshoot and optimize data pipelines and Spark workloads.

Skills

PySpark & Spark SQL

Data Lakehouse Architecture

SharePoint Integration

Tools

Azure Data Factory

Azure Databricks

Delta Lake

ADLS Gen2

Synapse

Azure Key Vault

Job description

Experience: 5+ Years
Location: Hybrid – Pakistan
Working Hours: UAE Business Hours

Job Summary

We are looking for a Senior Azure Data Engineer with 5+ years of hands‑on experience in designing and developing scalable data solutions on Microsoft Azure.

Key Skills

• Microsoft SharePoint Integration
• PySpark & Spark SQL
• Data Lakehouse Architecture

Responsibilities

• Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks.
• Develop data transformation solutions using PySpark, Spark SQL, and Delta Lake.
• Build and maintain Data Lakehouse solutions using ADLS Gen2.
• Work with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL for data integration and processing.
• Implement secure integrations using Azure Key Vault and SharePoint.
• Troubleshoot and optimize data pipelines and Spark workloads.

Note: Candidate must be comfortable working in UAE business hours and following the UAE public holiday calendar.