Senior Azure Data Engineer: Data Lakehouse & Pipelines

NorthBay Solutions; Karachi Division; Híbrido; PKR 1.800.000 - 3.000.000; Jornada completa

Descripción de la vacante

NorthBay Solutions is seeking a Senior Azure Data Engineer in hybrid Pakistan to design and build scalable data solutions on Azure. You will work with ADF, Databricks, Synapse, and ADLS Gen2 to deliver end-to-end data pipelines.

You will transform data with PySpark, Spark SQL, and Delta Lake, and ensure secure integration using Key Vault and SharePoint. UAE hours note: align with UAE business hours.

Formación

• 5+ years of hands-on experience with Azure data services.
• Strong data engineering expertise in ETL/ELT and data pipelines.
• Experience designing scalable data solutions in Azure.

Responsabilidades

• Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks.
• Develop data transformation solutions using PySpark, Spark SQL, and Delta Lake.
• Build and maintain Data Lakehouse solutions using ADLS Gen2.
• Work with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL for data integration and processing.
• Implement secure integrations using Azure Key Vault and SharePoint.
• Troubleshoot and optimize data pipelines and Spark workloads.

Conocimientos

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Azure Event Hub

Azure Data Lake Storage Gen2

PySpark & Spark SQL

Delta Lake & Delta Tables

Data Lakehouse Architecture

Azure Logic Apps & Function Apps

Azure SQL Database

Azure Key Vault

Herramientas

SharePoint Integration

Descripción del empleo

NorthBay Solutions is seeking a Senior Azure Data Engineer in hybrid Pakistan to design and build scalable data solutions on Azure. You will work with ADF, Databricks, Synapse, and ADLS Gen2 to deliver end-to-end data pipelines.

You will transform data with PySpark, Spark SQL, and Delta Lake, and ensure secure integration using Key Vault and SharePoint. UAE hours note: align with UAE business hours.