Principal Software Engineer (Data Platform)

NorthBay Solutions; Pakistan; Hybrid; PKR 300,000 - 420,000; Full time

Job summary

NorthBay Solutions is seeking a Senior Azure Data Engineer in Pakistan to design and develop scalable data solutions on Microsoft Azure. You will lead end-to-end ETL/ELT pipelines using ADF and Azure Databricks, with a focus on secure, high-performance data processing.

Ideal candidates have 5+ years of hands-on Azure data engineering experience, strong skills in PySpark, Spark SQL, Delta Lake and data lakehouse architectures, and the ability to collaborate across cross-functional teams while

Qualifications

• 5+ years of hands-on experience in designing and developing scalable data solutions on Microsoft Azure.
• Proven experience building scalable ETL/ELT pipelines and data integrations on Azure cloud.
• Strong analytic and problem-solving skills with focus on data quality and governance.

Responsibilities

• Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks.
• Develop data transformation solutions using PySpark, Spark SQL, and Delta Lake.
• Build and maintain Data Lakehouse solutions using ADLS Gen2.
• Work with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL for data integration and processing.
• Implement secure integrations using Azure Key Vault and SharePoint.
• Troubleshoot and optimize data pipelines and Spark workloads.

Tools

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Azure Event Hub

Azure Data Lake Storage Gen2

Azure Logic Apps

Azure Function Apps

Azure SQL Database

Azure Key Vault

SharePoint Integration

PySpark

Spark SQL

Delta Lake

Delta Tables

Data Lakehouse Architecture

Job description

Senior Azure Data Engineer

Experience: 5+ Years
Location: Hybrid - Pakistan
Working Hours: UAE Business Hours

Job Summary

We are looking for a Senior Azure Data Engineer with 5+ years of hands-on experience in designing and developing scalable data solutions on Microsoft Azure.

Key Skills

• Azure Data Factory
• Azure Databricks
• Azure Synapse Analytics
• Azure Event Hub
• Azure Data Lake Storage Gen2
• Azure Logic Apps & Function Apps
• Azure SQL Database
• Azure Key Vault
• Microsoft SharePoint Integration
• PySpark & Spark SQL
• Delta Lake & Delta Tables
• Data Lakehouse Architecture

Responsibilities

• Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks.
• Develop data transformation solutions using PySpark, Spark SQL, and Delta Lake.
• Build and maintain Data Lakehouse solutions using ADLS Gen2.
• Work with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL for data integration and processing.
• Implement secure integrations using Azure Key Vault and SharePoint.
• Troubleshoot and optimize data pipelines and Spark workloads.

Note: Candidate must be comfortable working in UAE business hours and following the UAE public holiday calendar.