Senior Data Platform Engineer — On-Prem Big Data

Visa Hunt; Amsterdam; Hybrid; EUR 90,000 - 130,000; Full time

Job summary

Adyen is seeking a Data Platform Engineer to build and operate scalable data tooling for our big data platforms. You will collaborate with data engineers, ML scientists, and engineers to run thousands of Spark jobs and manage large‑scale storage and processing across on‑premises systems.

You will develop new tooling, improve existing platforms, and help advance data quality, metadata, and streaming pipelines using Kafka, Spark streaming, and Kubernetes in an office‑based Amsterdam environment.

Qualifications

• 6+ years of Python OO development experience.
• Experience with distributed data and compute systems (Spark, Trino, Druid).
• Experience in DevOps pipelines and data tooling.

Responsibilities

• Develop and maintain scalable, high‑performance big data platforms.
• Work with distributed systems across databases, filesystems, compute.
• Improve release, deployment, and data discoverability tools.
• Extend tools to improve data quality across the platform.

Skills

Python OO programming

Communication skills

Stakeholder collaboration

Distributed data systems

Tools

Spark

Trino

Druid

Kafka

Spark streaming

Kubernetes

Docker

Hadoop (Hive/Yarn/HDFS)

Job description

Adyen is seeking a Data Platform Engineer to build and operate scalable data tooling for our big data platforms. You will collaborate with data engineers, ML scientists, and engineers to run thousands of Spark jobs and manage large‑scale storage and processing across on‑premises systems.

You will develop new tooling, improve existing platforms, and help advance data quality, metadata, and streaming pipelines using Kafka, Spark streaming, and Kubernetes in an office‑based Amsterdam environment.