Principal Software Engineer (Data Platform)

NorthBay Solutions; Karachi Division; On-site; PKR 1,800,000 - 3,000,000; Full time

Job summary

NorthBay Solutions is seeking a Senior Azure Data Engineer in hybrid Pakistan to design and build scalable data solutions on Azure. You will work with ADF, Databricks, Synapse, and ADLS Gen2 to deliver end-to-end data pipelines.

You will transform data with PySpark, Spark SQL, and Delta Lake, and ensure secure integration using Key Vault and SharePoint. UAE hours note: align with UAE business hours.

Qualifications

• 5+ years of hands-on experience with Azure data services.
• Strong data engineering expertise in ETL/ELT and data pipelines.
• Experience designing scalable data solutions in Azure.

Responsibilities

• Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks.
• Develop data transformation solutions using PySpark, Spark SQL, and Delta Lake.
• Build and maintain Data Lakehouse solutions using ADLS Gen2.
• Work with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL for data integration and processing.
• Implement secure integrations using Azure Key Vault and SharePoint.
• Troubleshoot and optimize data pipelines and Spark workloads.

Skills

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Azure Event Hub

Azure Data Lake Storage Gen2

PySpark & Spark SQL

Delta Lake & Delta Tables

Data Lakehouse Architecture

Azure Logic Apps & Function Apps

Azure SQL Database

Azure Key Vault

Tools

SharePoint Integration

Job description

Experience: 5+ Years
Location: Hybrid - Pakistan
Working Hours: UAE Business Hours

Job Summary

We are looking for a Senior Azure Data Engineer with 5+ years of hands-on experience in designing and developing scalable data solutions on Microsoft Azure.

Key Skills

• Azure Data Factory
• Azure Databricks
• Azure Synapse Analytics
• Azure Event Hub
• Azure Data Lake Storage Gen2
• Azure Logic Apps & Function Apps
• Azure SQL Database
• Azure Key Vault
• Microsoft SharePoint Integration
• PySpark & Spark SQL
• Delta Lake & Delta Tables
• Data Lakehouse Architecture

Responsibilities

• Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks.
• Develop data transformation solutions using PySpark, Spark SQL, and Delta Lake.
• Build and maintain Data Lakehouse solutions using ADLS Gen2.
• Work with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL for data integration and processing.
• Implement secure integrations using Azure Key Vault and SharePoint.
• Troubleshoot and optimize data pipelines and Spark workloads.

Note: Candidate must be comfortable working in UAE business hours and following the UAE public holiday calendar.