Senior Azure Data Engineer: Pipelines, Databricks & PySpark

Zohorecruit; Amsterdam; On-site; EUR 90,000 - 120,000; Full time

Job summary

Zohorecruit seeks a senior data engineer to design, build, and maintain enterprise-scale data pipelines in Azure. You will leverage ADF, Databricks, and PySpark to deliver robust ETL/ELT solutions and ensure data quality across business domains.

Collaborating with cross-functional teams, you will implement CI/CD pipelines in Azure DevOps, optimize performance, and ensure security/governance standards while staying current with cloud data engineering best practices.

Qualifications

• 8-10 years of professional data engineering or cloud data role.
• Hands-on Azure Data Factory for orchestration and movement.
• Hands-on Azure Databricks for scalable processing.
• Strong Python and PySpark programming skills.
• Proficient in SQL and handling large datasets.
• Experience with ETL/ELT pipelines and data security practices.

Responsibilities

• Design and develop scalable data pipelines using Azure Data Factory and Azure Databricks.
• Develop PySpark applications for processing large data volumes.
• Write clean, maintainable Python-based data solutions.
• Build and manage CI/CD workflows in Azure DevOps.
• Perform data extraction, transformation, loading, validation across sources.

Skills

Azure Data Factory

Azure Databricks

PySpark

Python

SQL

Data Engineering

CI/CD

Tools

Azure DevOps

Job description

Zohorecruit seeks a senior data engineer to design, build, and maintain enterprise-scale data pipelines in Azure. You will leverage ADF, Databricks, and PySpark to deliver robust ETL/ELT solutions and ensure data quality across business domains.

Collaborating with cross-functional teams, you will implement CI/CD pipelines in Azure DevOps, optimize performance, and ensure security/governance standards while staying current with cloud data engineering best practices.