Data Platform Engineer: Core Data Mastery & Pipelines

Flow Traders; Amsterdam; On-site; EUR 65,000 - 90,000; Full time

Job summary

A leading trading firm in Amsterdam is seeking a Core Data Engineer to manage the lifecycle of critical data products. You will develop automated data pipelines and collaborate across teams to deliver high-quality data. The ideal candidate has Python programming skills, experience with big data, and strong project management abilities. This full-time role demands an organized individual who can balance stakeholder needs while ensuring the quality and applicability of data products.

Qualifications

• Excellent programming skills in any language, preferably Python.
• Proficiency in Linux, SQL, and both relational and non-relational databases.
• Ability to work with large datasets and experience with big data solutions.

Responsibilities

• Deliver timely and high-quality core data products.
• Develop and manage the end-to-end lifecycle of data products.
• Create a common data model across data products.
• Evaluate and onboard new data sources.
• Automate workflows and provide guidance on data architecture.

Skills

Programming skills (Python preferred)

Working proficiency with Linux

SQL and relational/non-relational databases

Experience with large datasets

Airflow

Kafka

GCP

Organized and detail-oriented

Interpersonal skills

Project management

Tools

Pandas

Spark

Apache Beam

Apache NiFi

Job description

A leading trading firm in Amsterdam is seeking a Core Data Engineer to manage the lifecycle of critical data products. You will develop automated data pipelines and collaborate across teams to deliver high-quality data. The ideal candidate has Python programming skills, experience with big data, and strong project management abilities. This full-time role demands an organized individual who can balance stakeholder needs while ensuring the quality and applicability of data products.