Developer – Azure Databricks / Python / PySpark - 10967958

ITProposal; Amsterdam; On-site; EUR 90,000 - 130,000; Full time

Job summary

ITProposal in Amsterdam is seeking an experienced Developer / Data Engineer specializing in Azure Databricks, Python and PySpark to build robust data-processing solutions. The role focuses on hands-on data processing within a Databricks environment and requires deep expertise in designing scalable pipelines and data models.

You will work in an on-site setting, collaborating with architects and engineers in an Agile team to deliver reliable data-processing platforms and maintainable codebases

Qualifications

• Hands-on experience with Azure Databricks in production environments.
• Proficient Python and PySpark for data processing tasks.
• Deep SQL expertise and data modeling within Databricks.
• Experience designing and managing streaming and batch pipelines.
• Strong Azure cloud knowledge and CI/CD with YAML.
• Experience IaC with ARM/Bicep and infrastructure management.
• Proven ability to work in Agile teams and manage parallel data processes.
• 8–10 years of relevant professional experience.

Responsibilities

• Design, develop, and maintain data-processing solutions in Azure Databricks.
• Build batch and streaming data pipelines.
• Develop scalable Python, PySpark, and SQL solutions.
• Design data models within Databricks and manage shared data sources.
• Ensure stability, reliability, and scalability of data processing.
• Collaborate with engineers and stakeholders in Agile environment.
• Implement CI/CD pipelines using YAML and IaC (ARM/Bicep).

Skills

Azure Databricks

Python

PySpark

SQL

CI/CD (YAML)

IaC (ARM/Bicep)

Azure cloud services

Agile development

Data processing pipelines

Streaming & batch processing

Job description

About the job Developer – Azure Databricks / Python / PySpark - 10967958

Location: Amsterdam, Netherlands

Work Arrangement: Fully Onsite

Experience: 8–10 years

Languages: English

Contract Duration: To be confirmed

Core Skills: Python, Azure Databricks, PySpark

Job Description

We are looking for an experienced Developer / Data Engineer with strong hands‑on expertise in Azure Databricks, Python, and PySpark. The ideal candidate will specialize in building robust, reliable, and maintainable data‑processing solutions within a Databricks environment.

This role is focused on data processing engineering within Databricks, rather than traditional Business Intelligence (BI), data enrichment, or reporting architectures. The successful candidate should have deep practical experience managing complex data processes and making sound technical decisions in a continuously evolving architecture.

Key Responsibilities

• Design, develop, and maintain robust data-processing solutions using Azure Databricks.
• Build and manage batch and streaming data-processing pipelines.
• Develop scalable solutions using Python, PySpark, and SQL.
• Design appropriate data models within the Databricks environment.
• Manage and control multiple parallel data processes working with shared source data.
• Ensure data-processing solutions are stable, reliable, maintainable, and scalable.
• Work with Azure cloud services and implement CI/CD pipelines using YAML.
• Develop and maintain infrastructure using Infrastructure as Code (IaC), particularly ARM/Bicep.
• Identify and resolve technical issues while minimizing technical debt.
• Contribute to continuous improvement of the data-processing environment and development practices.
• Collaborate closely with other engineers, architects, and stakeholders in an Agile environment.
• Make pragmatic technical decisions without unnecessary over‑engineering or blindly applying design patterns.

Must-Have Skills

• Strong, hands‑on experience with Azure Databricks.
• Deep expertise in Python and PySpark.
• Strong SQL skills.
• Proven experience designing and managing data processing within Databricks.
• Experience with both streaming and batch data processing.
• Experience designing data models within Databricks.
• Experience managing multiple parallel data processes using shared source data.
• Solid experience with Microsoft Azure cloud services.
• Hands‑on experience with CI/CD pipelines using YAML.
• Experience with Infrastructure as Code, particularly ARM and/or Bicep.
• Experience working in an Agile development environment.
• 8–10 years of relevant professional experience.

Nice-to-Have

• Broader understanding of end-to-end data solutions.
• Experience working within complex and evolving data architectures.
• Understanding of best practices for building highly reliable and maintainable data platforms.

Soft Skills & Professional Competencies

The Ideal Candidate Should Demonstrate

• Strong focus on quality, reliability, and maintainability.
• A proactive mindset and commitment to continuous improvement.
• Strong collaboration and communication skills.
• A structured and analytical approach to problem-solving.
• A pragmatic engineering mindset.
• Ability to make well‑founded technical decisions.
• Ability to avoid unnecessary complexity and over‑engineering.
• Strong ownership of solutions from development through to reliable operation.

What We Are Looking For

We are specifically looking for a pragmatic Azure Databricks/Python specialist with genuine, deep hands‑on experience—not someone with only superficial exposure to Databricks.

The successful candidate will be comfortable managing and controlling data within a Databricks environment, building stable and high‑quality processing solutions, and working effectively within a complex technical architecture.