PySpark/Databricks Data Engineer — Build Pipelines, Remote

APG; Amsterdam; Hybrid; EUR 59,605 - 85,150; Full time

Benefits offered by this job

8.33% annual bonus

Work from home 2-3 days per week

Pension plan

Job summary

APG is seeking a PySpark/Databricks Developer to build and maintain data pipelines for Investment and Research Platforms. You will streamline data flows, translate business requirements into scalable data solutions, and collaborate with analytics teams to enhance BI data models.

You will manage Databricks workspaces, ensure CI/CD via Azure DevOps, and engage with front office and IT teams. A strong background in data modeling and English communication is essential.

Qualifications

• 5+ years of experience with data pipelines and Databricks.
• Strong PySpark, Databricks, and Python skills.
• Experience with Azure Data Platform and DevOps.

Responsibilities

• Develop and maintain PySpark-based data pipelines in Databricks.
• Manage Databricks workspaces, dependencies, and integrations.
• Translate business requirements into scalable data solutions.
• Collaborate with analytics teams to enhance data models for BI tools.
• Maintain Azure DevOps repositories for version control and CI/CD.
• Document solutions and share knowledge within the team.
• Engage with stakeholders including front office, IT, and architecture teams.

Skills

PySpark

Databricks

Python

Data modeling

Querying

English communication

Education

Computer Science / Engineering degree

Tools

Azure Data Platform

DevOps practices

SQL

Job description

APG is seeking a PySpark/Databricks Developer to build and maintain data pipelines for Investment and Research Platforms. You will streamline data flows, translate business requirements into scalable data solutions, and collaborate with analytics teams to enhance BI data models.

You will manage Databricks workspaces, ensure CI/CD via Azure DevOps, and engage with front office and IT teams. A strong background in data modeling and English communication is essential.