Senior Databricks PySpark Engineer (Python) – Data Pipelines

Itproposal

Amsterdam

Hybrid

EUR 70,000 - 110,000

Part time

3 days ago

Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Itproposal is seeking an experienced PySpark/Databricks Developer to build scalable data pipelines and optimize distributed processing. You will work in an Agile environment with data engineers, product owners, and platform teams to deliver production-ready data solutions.

The role requires strong PySpark (Databricks) experience, Python development skills, and familiarity with orchestration tools such as Airflow. This is a hybrid position with partial on-site work in Amsterdam.

Qualifications

5+ years of hands-on PySpark (Databricks) experience.
Strong Python development skills for data engineering.
Experience with Agile delivery environments.

Responsibilities

Develop, optimize, and maintain PySpark data pipelines on Databricks.
Write clean, scalable Python code for data transformations and processing.
Work with Airflow for scheduling and workflow management (preferred).
Collaborate with cross-functional teams to refine requirements and deliver high-quality data solutions.
Ensure data quality, reliability, and performance across all pipelines.
Troubleshoot issues, perform root cause analysis, and implement fixes in production environments.
Contribute to Agile ceremonies and support continuous improvement within the team.
Document technical designs, data flows, and pipeline logic.