Azure Databricks Data Engineer — Python & PySpark

ITProposal; Amsterdam; On-site; EUR 90,000 - 130,000; Full time

Job summary

ITProposal in Amsterdam is seeking an experienced Developer / Data Engineer specializing in Azure Databricks, Python and PySpark to build robust data-processing solutions. The role focuses on hands-on data processing within a Databricks environment and requires deep expertise in designing scalable pipelines and data models.

You will work in an on-site setting, collaborating with architects and engineers in an Agile team to deliver reliable data-processing platforms and maintainable codebases

Qualifications

• Hands-on experience with Azure Databricks in production environments.
• Proficient Python and PySpark for data processing tasks.
• Deep SQL expertise and data modeling within Databricks.
• Experience designing and managing streaming and batch pipelines.
• Strong Azure cloud knowledge and CI/CD with YAML.
• Experience IaC with ARM/Bicep and infrastructure management.
• Proven ability to work in Agile teams and manage parallel data processes.
• 8–10 years of relevant professional experience.

Responsibilities

• Design, develop, and maintain data-processing solutions in Azure Databricks.
• Build batch and streaming data pipelines.
• Develop scalable Python, PySpark, and SQL solutions.
• Design data models within Databricks and manage shared data sources.
• Ensure stability, reliability, and scalability of data processing.
• Collaborate with engineers and stakeholders in Agile environment.
• Implement CI/CD pipelines using YAML and IaC (ARM/Bicep).

Skills

Azure Databricks

Python

PySpark

SQL

CI/CD (YAML)

IaC (ARM/Bicep)

Azure cloud services

Agile development

Data processing pipelines

Streaming & batch processing

Job description

ITProposal in Amsterdam is seeking an experienced Developer / Data Engineer specializing in Azure Databricks, Python and PySpark to build robust data-processing solutions. The role focuses on hands-on data processing within a Databricks environment and requires deep expertise in designing scalable pipelines and data models.

You will work in an on-site setting, collaborating with architects and engineers in an Agile team to deliver reliable data-processing platforms and maintainable codebases