Data Engineer – Real-Time Analytics & Big Data

DigiGamma; Haarlem; Hybrid; EUR 70,000 - 95,000; Full time

Benefits offered by this job

Remote work once a week

Continuous learning budget

Free coffee/tea/fruits

Job summary

DigiGamma is seeking a Data Engineer to design, develop, and operate large-scale data systems in a fast-growing Dutch e-commerce environment. You will focus on real-time indexing pipelines, streaming analytics, and distributed ML infrastructure, collaborating with engineers, PMs, and architects to deliver robust solutions.

Ideal candidates have 4+ years in object-oriented programming (Java/Scala), 3+ years building data pipelines with Spark/Kafka/Hadoop ecosystem, and strong CS fundamentals.

Qualifications

• Bachelor’s degree in Computer Science or related field.
• 4+ years of object-oriented programming experience in Java or Scala.
• 3+ years building large-scale data pipelines using Spark/Kafka/Cassandra/Hadoop/Hive/Presto/Airflow.
• 3+ years of experience in systems design, algorithms, and distributed systems.
• 3+ years of scripting languages (e.g. Python), and SQL.

Responsibilities

• Design, develop and operate large-scale data systems focusing on scalability, latency, and fault tolerance.
• Create and operate web analytics solutions handling millions of daily clickstream events.
• Own end-to-end life cycle of business data solutions from requirements to production.
• Troubleshoot business and production issues and optimize for speed and cost.

Skills

Distributed systems

Cloud infrastructure

Communication skills

Education

Bachelor's degree in Computer Science or related field

Tools

Spark

Kafka

Cassandra

Hadoop

Hive

Presto

Airflow

Docker

Kubernetes

OpenStack

AWS

GCP

Job description

DigiGamma is seeking a Data Engineer to design, develop, and operate large-scale data systems in a fast-growing Dutch e-commerce environment. You will focus on real-time indexing pipelines, streaming analytics, and distributed ML infrastructure, collaborating with engineers, PMs, and architects to deliver robust solutions.

Ideal candidates have 4+ years in object-oriented programming (Java/Scala), 3+ years building data pipelines with Spark/Kafka/Hadoop ecosystem, and strong CS fundamentals.