Principal Software Engineer (Data Platform)

NorthBay Solutions; Lahore; On-site; PKR 2,000,000 - 4,200,000; Full time

Job summary

NorthBay Solutions seeks a Senior Azure Data Engineer with 5+ years of hands-on experience to design and build scalable data solutions on Microsoft Azure. The role is hybrid, aligned to UAE business hours, and focuses on delivering robust data pipelines and lakehouse architectures.

You will work with Azure Data Factory, Databricks, Synapse, and related services to enable secure, scalable data processing and analytics for client projects.

Qualifications

• 5+ years of hands-on experience designing and developing data solutions on Microsoft Azure.
• Strong experience with ETL/ELT design and scalable architectures in cloud data platforms.
• Proficient in multiple Azure data services and data lakehouse concepts.

Responsibilities

• Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks.
• Develop data transformation solutions with PySpark, Spark SQL, and Delta Lake.
• Build Data Lakehouse solutions using ADLS Gen2.
• Integrate data with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL.
• Implement secure integrations using Azure Key Vault and SharePoint; optimize pipelines.

Skills

ETL/ELT pipelines

Cloud data engineering

Tools

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Azure Event Hub

Azure Data Lake Storage Gen2

Azure Logic Apps

Azure Function Apps

Azure SQL Database

Azure Key Vault

SharePoint Integration

PySpark

Spark SQL

Delta Lake

Delta Tables

Data Lakehouse Architecture

Job description

Senior Azure Data Engineer

Experience: 5+ Years
Location: Hybrid – Pakistan
Working Hours: UAE Business Hours

Job Summary

We are looking for a Senior Azure Data Engineer with 5+ years of hands-on experience in designing and developing scalable data solutions on Microsoft Azure.

Key Skills

• Azure Data Factory
• Azure Databricks
• Azure Synapse Analytics
• Azure Event Hub
• Azure Data Lake Storage Gen2
• Azure Logic Apps & Function Apps
• Azure SQL Database
• Azure Key Vault
• Microsoft SharePoint Integration
• PySpark & Spark SQL
• Delta Lake & Delta Tables
• Data Lakehouse Architecture

Responsibilities

• Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks.
• Develop data transformation solutions using PySpark, Spark SQL, and Delta Lake.
• Build and maintain Data Lakehouse solutions using ADLS Gen2.
• Work with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL for data integration and processing.
• Implement secure integrations using Azure Key Vault and SharePoint.
• Troubleshoot and optimize data pipelines and Spark workloads.

Note: Candidate must be comfortable working in UAE business hours and following the UAE public holiday calendar.