Data engineer

Wypoon Technologies; Amsterdam; On-site; EUR 90,000 - 140,000; Full time

Job summary

Wypoon Technologies ищет Data Engineer для построения надёжной, масштабируемой облачной платформы данных в очертанном масштабе Нидерландов. Ваша роль — проектирование и развертывание end-to-end решений на основе GCP, работа с потоковыми данными и современными технологиями.

У вас есть опыт работы с Java/Scala, Spark Structured Streaming и Kafka, а также умение развивать решения в условиях сложной корпоративной среды и взаимодействовать со стейкхолдерами.

Qualifications

• Medior/Senior-level Data Engineering experience with focus on real‑time processing
• Strong programming skills in Java and/or Scala
• Hands-on production experience with Spark Structured Streaming
• Extensive experience with Apache Kafka (topics, producers, consumers, pipelines)
• Hands-on experience with Google Cloud Platform (GCP)
• Experience with NoSQL databases
• Ability to own end-to-end technical solutions and communicate with stakeholders

Responsibilities

• Design, build and maintain scalable real-time data pipelines and event streaming solutions using Apache Kafka, Spark and GCP
• Develop event refinement, transformation and event combination solutions for multiple business use cases
• Build and optimize streaming applications using Java and/or Scala, focusing on Spark Structured Streaming
• Modernize legacy SQL/SSRS reports by migrating to a real-time data platform
• Develop real-time monitoring and reporting solutions from PoC to production MVP
• Design scalable data architectures and ensure reliable integration between streaming platforms, NoSQL databases and cloud services
• Write clean, maintainable, well-tested, and documented code with strong engineering practices
• Collaborate with engineering teams and business stakeholders, taking ownership of technical solutions in a complex enterprise environment

Skills

Data engineering

Java

Scala

Apache Spark

Apache Kafka

GCP

NoSQL

Real-time processing

End-to-end ownership

Communication

Tools

Apache Kafka

Apache Spark

GCP

NoSQL databases

Job description

Описание

Are you a Data Engineer who thrives on building robust, scalable, and secure data platforms in the cloud? Join the Data Chapter at Wypoon Technologies, where we match top-tier engineering talent with impactful opportunities across the Netherlands. You’ll help design and deliver end-to-end data solutions for leading organizations, working with cutting-edge technologies across GCP.

Задачи

• Design, build, and maintain scalable real-time data pipelines and event streaming solutions using Apache Kafka, Apache Spark, and GCP.


• Develop event refinement, transformation, and event combination solutions to support multiple operational business use cases.


• Build and optimize streaming applications using Java and/or Scala, with a focus on Apache Spark Structured Streaming.


• Contribute to the modernization of legacy SQL/SSRS reporting systems, migrating operational reporting to a modern real-time data platform.


• Develop and enhance real-time monitoring and reporting solutions, taking projects from Proof of Concept (PoC) to production-ready MVP.


• Design scalable data architectures and ensure reliable integration between streaming platforms, NoSQL databases, and cloud services.


• Develop clean, maintainable, well-tested, and documented code following strong engineering practices.


• Collaborate with engineering teams and business stakeholders, independently taking ownership of technical solutions in a complex enterprise environment.

Требования

• Medior/Senior-level Data Engineering experience, with a strong focus on real-time data processing and event-driven architectures.


• Strong programming skills in Java and/or Scala.


• Hands-on production experience with Apache Spark, particularly Structured Streaming.


• Strong experience with Apache Kafka, including topics, producers, consumers, and streaming pipelines.


• Hands-on experience with Google Cloud Platform (GCP).


• Experience working with NoSQL databases.


• Strong understanding of real-time data processing, event transformation, data integration, and scalable data architectures.


• Experience developing reliable, production-grade data pipelines with appropriate testing, monitoring, and documentation.


• Ability to work independently, solve complex technical challenges, and take end-to-end ownership of solutions.


• Strong communication skills and the ability to collaborate with technical and business stakeholders, even with limited business support.

Условия

At Wypoon Technologies, you’ll work on dynamic projects for industry leaders such as Heineken, ING, ASML, Philips, and Shell, tackling exciting challenges and delivering tailored enterprise solutions. Shape the future of our clients’ digital landscapes. Collaborate within a supportive team that values learning and growth. Access the latest tools and platforms.