Principal Software Engineer (Data Platform)

NorthBay Solutions; Karachi Division; Sur place; PKR 1 800 000 - 3 000 000; Plein temps

Résumé du poste

NorthBay Solutions is seeking a Senior Azure Data Engineer in hybrid Pakistan to design and build scalable data solutions on Azure. You will work with ADF, Databricks, Synapse, and ADLS Gen2 to deliver end-to-end data pipelines.

You will transform data with PySpark, Spark SQL, and Delta Lake, and ensure secure integration using Key Vault and SharePoint. UAE hours note: align with UAE business hours.

Qualifications

• 5+ years of hands-on experience with Azure data services.
• Strong data engineering expertise in ETL/ELT and data pipelines.
• Experience designing scalable data solutions in Azure.

Responsabilités

• Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks.
• Develop data transformation solutions using PySpark, Spark SQL, and Delta Lake.
• Build and maintain Data Lakehouse solutions using ADLS Gen2.
• Work with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL for data integration and processing.
• Implement secure integrations using Azure Key Vault and SharePoint.
• Troubleshoot and optimize data pipelines and Spark workloads.

Connaissances

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Azure Event Hub

Azure Data Lake Storage Gen2

PySpark & Spark SQL

Delta Lake & Delta Tables

Data Lakehouse Architecture

Azure Logic Apps & Function Apps

Azure SQL Database

Azure Key Vault

Outils

SharePoint Integration

Description du poste

Experience: 5+ Years
Location: Hybrid - Pakistan
Working Hours: UAE Business Hours

Job Summary

We are looking for a Senior Azure Data Engineer with 5+ years of hands-on experience in designing and developing scalable data solutions on Microsoft Azure.

Key Skills

• Azure Data Factory
• Azure Databricks
• Azure Synapse Analytics
• Azure Event Hub
• Azure Data Lake Storage Gen2
• Azure Logic Apps & Function Apps
• Azure SQL Database
• Azure Key Vault
• Microsoft SharePoint Integration
• PySpark & Spark SQL
• Delta Lake & Delta Tables
• Data Lakehouse Architecture

Responsibilities

• Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks.
• Develop data transformation solutions using PySpark, Spark SQL, and Delta Lake.
• Build and maintain Data Lakehouse solutions using ADLS Gen2.
• Work with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL for data integration and processing.
• Implement secure integrations using Azure Key Vault and SharePoint.
• Troubleshoot and optimize data pipelines and Spark workloads.

Note: Candidate must be comfortable working in UAE business hours and following the UAE public holiday calendar.