Principal Software Engineer (Data Platform)

NorthBay Solutions LLC; Karachi Division; Hybrid; PKR 2,200,000 - 3,200,000; Full time

Job summary

NorthBay Solutions LLC is seeking a Senior Azure Data Engineer with 5+ years of hands-on experience to design and develop scalable data solutions on Microsoft Azure in a hybrid Pakistan-based setup.

You will work with ADF, Databricks, Synapse, Event Hub, and ADLS Gen2, building Data Lakehouse architectures, and ensuring secure integrations using Key Vault and SharePoint.

Qualifications

• 5+ years of hands-on Azure data engineering experience.
• Proficient in designing scalable data solutions on Microsoft Azure.
• Experience with data lakehouse architectures.
• Strong PySpark and Spark SQL skills.

Responsibilities

• Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks.
• Develop data transformation solutions using PySpark, Spark SQL, and Delta Lake.
• Build and maintain Data Lakehouse solutions using ADLS Gen2.
• Work with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL for data integration and processing.
• Implement secure integrations using Azure Key Vault and SharePoint.
• Troubleshoot and optimize data pipelines and Spark workloads.

Skills

ETL/ELT design

Data modeling

DWH architecture

Python (PySpark)

Tools

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Azure Event Hub

Azure Data Lake Storage Gen2

Azure Logic Apps & Function Apps

Azure SQL Database

Azure Key Vault

SharePoint Integration

PySpark

Spark SQL

Delta Lake

Data Lakehouse Architecture

Job description

Experience: 5+ Years
Location: Hybrid – Pakistan
Working Hours: UAE Business Hours

Job Summary

We are looking for a Senior Azure Data Engineer with 5+ years of hands‑on experience in designing and developing scalable data solutions on Microsoft Azure.

Key Skills

• Azure Data Factory
• Azure Databricks
• Azure Synapse Analytics
• Azure Event Hub
• Azure Data Lake Storage Gen2
• Azure Logic Apps & Function Apps
• Azure SQL Database
• Azure Key Vault
• Microsoft SharePoint Integration
• PySpark & Spark SQL
• Delta Lake & Delta Tables
• Data Lakehouse Architecture

Responsibilities

• Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks.
• Develop data transformation solutions using PySpark, Spark SQL, and Delta Lake.
• Build and maintain Data Lakehouse solutions using ADLS Gen2.
• Work with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL for data integration and processing.
• Implement secure integrations using Azure Key Vault and SharePoint.
• Troubleshoot and optimize data pipelines and Spark workloads.

Note: Candidate must be comfortable working in UAE business hours and following the UAE public holiday calendar.