Azure Data Engineer

BlueRose Technologies; Amsterdam; Hybrid; EUR 70,000 - 110,000; Full time

Job summary

BlueRose Technologies Pvt. Ltd. in Amsterdam, Netherlands (Hybrid) seeks an experienced Azure Data Engineer to design, develop and optimize scalable data pipelines using Azure Databricks and Python.

The role requires expertise in Delta Lake, ADLS Gen2 and CI/CD practices with Azure DevOps. Candidates should demonstrate strong SQL skills, experience with large datasets, and client-facing communication abilities while collaborating with onsite/offshore teams to deliver robust data engineering

Qualifications

• Hands-on expertise in Azure Databricks and Python for ETL/ELT pipelines.
• Experience with Azure Data Factory for orchestration.
• Knowledge of ADLS Gen2 and Delta Lake/Lakehouse architectures.
• Excellent SQL skills and handling large datasets.
• Experience with CI/CD and Azure DevOps.
• Strong client-facing communication.

Responsibilities

• Design, develop and maintain scalable data pipelines using Azure Databricks and Python.
• Build and orchestrate ETL/ELT workflows with Azure Data Factory.
• Develop and manage data solutions using ADLS Gen2.
• Implement Delta Lake and Lakehouse architectures.
• Transform, process and integrate diverse datasets.
• Optimize pipelines for performance, scalability and reliability.
• Implement CI/CD for data pipelines and Databricks workloads with Azure DevOps.
• Monitor and resolve data pipeline issues.
• Collaborate with client stakeholders and onsite/offshore teams.

Skills

Azure Databricks

Python

Azure Data Factory

ADLS Gen2

Delta Lake

SQL

CI/CD

Azure DevOps

Communication

Client-facing

Job description

Location: Amsterdam, Netherlands (Hybrid)

Role Overview:

We are looking for experienced Azure Data Engineers with strong hands-on expertise in Azure Databricks, Python and Azure Data Engineering.

The ideal candidates should have experience designing and developing scalable ETL/ELT pipelines, implementing Delta Lake/Lakehouse solutions, optimizing data processing performance and managing CI/CD deployments using Azure DevOps.

Work Authorization:

Candidates must currently hold valid, permanent work authorization in Netherlands. Visa sponsorship or work permit sponsorship is not available for this position at this time.

Required Skills & Experience:

• Strong hands-on expertise in Azure Databricks and Python.
• Experience in Azure Data Factory (ADF) for ETL/ELT development and orchestration.
• Good knowledge of Azure Data Lake Storage (ADLS Gen2).
• Strong understanding of Delta Lake and Lakehouse concepts.
• Excellent SQL skills and experience handling large-scale datasets.
• Experience in data transformation, performance tuning and troubleshooting.
• Understanding of CI/CD and Azure DevOps.
• Strong communication and client-facing skills.

Key Responsibilities:

• Design, develop and maintain scalable data pipelines using Azure Databricks and Python.
• Build and orchestrate ETL/ELT workflows using Azure Data Factory (ADF).
• Develop and manage data solutions using Azure Data Lake Storage (ADLS Gen2).
• Implement Delta Lake and Lakehouse architecture solutions.
• Perform data transformation, processing and integration across structured and semi-structured datasets.
• Optimize data pipelines for performance, scalability and reliability.
• Implement CI/CD processes for data pipelines and Databricks workloads using Azure DevOps.
• Monitor, troubleshoot and resolve data pipeline issues.
• Collaborate with client stakeholders and onsite/offshore teams to deliver data engineering solutions.