Real-Time Data Engineer (Antwerp Onsite)

Mediahuis nv; Antwerpen; Sur place; EUR 70 000 - 110 000; Plein temps

Résumé du poste

Mediahuis nv is seeking a Senior Data Engineer to take ownership of the data foundation behind Traffic Dashboard. The role focuses on keeping the real-time platform stable, reliable, and scalable to deliver accurate insights to newsroom editors throughout the day.

You will own Elasticsearch, the real-time data pipeline, and the integration between Elasticsearch, Databricks and Traffic Dashboard. You’ll monitor for performance issues, gaps, and incidents, and implement robust testing, monitoring,

Qualifications

• Experience ownership of a real-time data platform.
• Strong troubleshooting and incident response skills.
• Experience with data quality, latency, and completeness checks.

Responsabilités

• Own the Elasticsearch environment ensuring health and scale.
• Own the real-time data pipeline feeding Traffic Dashboard and ensure data quality.
• Monitor performance, detect data gaps, and prevent incidents before users are affected.
• Design changes with testing, monitoring, and rollback strategies.
• Develop data workloads in Databricks and Spark; work with streaming tech like Kafka or Event Hubs.
• Improve observability, scalability, and maintainability of the platform.

Connaissances

Elasticsearch

Databricks

Apache Spark

Kafka

Azure Event Hubs

Real-time data pipelines

Observability

Outils

Elasticsearch

Databricks

Apache Spark

Kafka

Azure Event Hubs

Description du poste

Mediahuis nv is seeking a Senior Data Engineer to take ownership of the data foundation behind Traffic Dashboard. The role focuses on keeping the real-time platform stable, reliable, and scalable to deliver accurate insights to newsroom editors throughout the day.

You will own Elasticsearch, the real-time data pipeline, and the integration between Elasticsearch, Databricks and Traffic Dashboard. You’ll monitor for performance issues, gaps, and incidents, and implement robust testing, monitoring,