PySpark Databricks Engineer — Hybrid/Remote

ITProposal; Amsterdam; Hybrid; EUR 90,000 - 110,000; Full time

Job summary

ITProposal, based in Amsterdam, seeks an experienced PySpark/Databricks Developer to build scalable data pipelines and optimize distributed processing. You will deliver production-ready data solutions using PySpark, Databricks, Python, and optionally Airflow within an Agile team.

The role combines 2 days onsite and 3 days remote, with an ASAP start and a 6-month term. Relevant experience and strong collaboration skills are essential for success.

Qualifications

• 5+ years of hands-on experience with PySpark (Databricks).
• Strong proficiency in Python for data engineering.
• Experience with Airflow (good to have, not mandatory).
• Solid understanding of distributed data processing and performance optimization.
• Experience working in Agile delivery environments.
• Strong communication skills and ability to collaborate with technical and non-technical stakeholders.

Responsibilities

• Develop, optimize, and maintain PySpark data pipelines on Databricks.
• Write clean, efficient, and scalable Python code for data transformations and processing.
• Work with orchestration tools such as Airflow for scheduling and workflow management (preferred).
• Collaborate with cross-functional teams to refine requirements and deliver high-quality data solutions.
• Ensure data quality, reliability, and performance across all pipelines.
• Troubleshoot issues, perform root cause analysis, and implement fixes in production environments.
• Contribute to Agile ceremonies and support continuous improvement within the team.
• Document technical designs, data flows, and pipeline logic.

Skills

PySpark

Databricks

Python development

Agile delivery

Data engineering

Communication skills

Tools

Airflow

Azure DevOps

Job description

ITProposal, based in Amsterdam, seeks an experienced PySpark/Databricks Developer to build scalable data pipelines and optimize distributed processing. You will deliver production-ready data solutions using PySpark, Databricks, Python, and optionally Airflow within an Agile team.

The role combines 2 days onsite and 3 days remote, with an ASAP start and a 6-month term. Relevant experience and strong collaboration skills are essential for success.