Senior Data Platform Engineer - OLAP

Adyen; Amsterdam; On-site; EUR 65,000 - 90,000; Full time

Job summary

Adyen in Amsterdam is seeking a Data Platform Engineer to build foundational tooling for our big data platforms. This role requires collaboration with data engineers and ML scientists to develop high-performance systems.

Ideal candidates have 6+ years of experience with Python or Java, as well as expertise in distributed systems and data modeling. The position offers the opportunity to shape innovative solutions in a dynamic tech environment.

Qualifications

• 6+ years of experience in Python or Java with object-oriented programming.
• Experience building and maintaining distributed compute/data systems.
• Strong understanding of real-time and batch processing pipelines.

Responsibilities

• Build and optimize innovative new tools and existing infrastructure.
• Develop and maintain high-performance, distributed big data platforms.
• Create tools for enhancing metadata collection and data quality.

Skills

Python

Java

Object-oriented programming

Communication

Distributed systems

Real-time and batch processing

DevOps pipelines

Tools

Spark

Trino

Druid

ClickHouse

Kafka

Job description

Adyen

Data Platform Engineers at Adyen build the foundational layer of tooling and processes for our on‑premise Big Data Platforms. These tools support a wide range of services and developers.

You’ll collaborate with data engineers, ML scientists, and DataOps Engineers to develop and operate large‑scale big data platforms, including a 500+ node cluster with 25k+ CPUs, 240+ TB of RAM, and 23+ PB of storage.

Your Focus Areas

• The OLAP Ecosystem: Scaling and optimizing our real‑time analytical powerhouses (Druid, FastAPI, Java, Kafka).
• The Data Engineering Ecosystem: Designing and building data contracts, validation frameworks, optimization tooling, and robust Kafka ingestion pipelines.

What You’ll Do

• Build innovative new tools from scratch while continuously improving existing infrastructure.
• Develop and maintain high‑performance, distributed big data platforms.
• Work deeply with databases, file systems, and compute engines.
• Create tools that enhance metadata collection, data lineage, and platform‑wide data quality.
• Optimize continuous release/deployment environments within a large‑scale private cloud.
• Develop stream processing applications to reduce time‑to‑insight for analysts and data scientists.

Who You Are

• Python or Java expert with 6+ years of experience in object‑oriented programming.
• Strong communicator who bridges teams (analysts, data scientists) and dependencies (infrastructure, security).
• Proven experience building and maintaining distributed compute/data systems (e.g., Spark, Trino, Druid, ClickHouse).
• Experience with real‑time and batch pipelines (Kafka, Spark Streaming), focusing on user‑friendliness and reliability.
• Knowledge of DevOps pipelines and data modeling tooling.