Senior Azure Databricks/Python Data Engineer

Itproposal; Amsterdam; On-site; EUR 85,000 - 135,000; Full time

Job summary

Itproposal is seeking an experienced Developer/Data Engineer to build robust data-processing pipelines in Azure Databricks using Python and PySpark. The role focuses on data processing engineering within a Databricks environment, not traditional BI or reporting.

The ideal candidate will design scalable data models, manage batch and streaming pipelines, and implement CI/CD pipelines in Azure, leveraging IaC (ARM/Bicep) where needed.

Qualifications

• 8–10 years of relevant professional experience.
• Strong hands-on experience with Azure Databricks.
• Deep expertise in Python and PySpark.

Responsibilities

• Design, develop, and maintain robust data-processing solutions using Azure Databricks.
• Build and manage batch and streaming data-processing pipelines.
• Develop scalable solutions using Python, PySpark, and SQL.
• Design appropriate data models within the Databricks environment.
• Collaborate with engineers and stakeholders in an Agile environment.

Skills

Azure Databricks

Python

PySpark

SQL

Tools

CI/CD YAML

ARM/Bicep

Azure cloud services

Job description

Itproposal is seeking an experienced Developer/Data Engineer to build robust data-processing pipelines in Azure Databricks using Python and PySpark. The role focuses on data processing engineering within a Databricks environment, not traditional BI or reporting.

The ideal candidate will design scalable data models, manage batch and streaming pipelines, and implement CI/CD pipelines in Azure, leveraging IaC (ARM/Bicep) where needed.