Senior Data Mesh Engineer — AWS, Kafka & Spark

DataChef; Nootdorp; On-site; EUR 60,000 - 80,000; Full time

Job summary

DataChef in Nootdorp is seeking a pragmatic Data Engineer to design and build a green-field data mesh platform on AWS. This role requires solid technical skills in Scala and Python, along with extensive AWS experience.

The ideal candidate will be involved in creating a scalable data foundation for a major distribution company, with a strong emphasis on problem-solving and project completion.

A collaborative mindset and advanced communication skills are essential for success in this consultant position.

Qualifications

• 2+ years of hands-on experience with AWS services like Lambda, EMR, and Glue.
• Solid understanding of building pub-sub systems using messaging APIs.
• Experience in collaborative environments using Linux/macOS, Docker, and git.

Responsibilities

• Design and build a green field data mesh platform on AWS.
• Create a scalable data foundation for a distribution company.
• Implement stream processing backend using AWS services and Apache Kafka.

Skills

Scala

Python

AWS services

Apache Kafka

Linux/macOS

Docker

Git

Data ingestion

Tools

Git

Docker

Job description

DataChef in Nootdorp is seeking a pragmatic Data Engineer to design and build a green-field data mesh platform on AWS. This role requires solid technical skills in Scala and Python, along with extensive AWS experience.

The ideal candidate will be involved in creating a scalable data foundation for a major distribution company, with a strong emphasis on problem-solving and project completion.

A collaborative mindset and advanced communication skills are essential for success in this consultant position.