Freelance Data Engineer

Mediahuis nv; Antwerpen; Hybride; EUR 70 000 - 110 000; Plein temps

Résumé du poste

Mediahuis nv is seeking a Senior Data Engineer to take ownership of the data foundation behind Traffic Dashboard. The role focuses on keeping the real-time platform stable, reliable, and scalable to deliver accurate insights to newsroom editors throughout the day.

You will own Elasticsearch, the real-time data pipeline, and the integration between Elasticsearch, Databricks and Traffic Dashboard. You’ll monitor for performance issues, gaps, and incidents, and implement robust testing, monitoring,

Qualifications

• Experience ownership of a real-time data platform.
• Strong troubleshooting and incident response skills.
• Experience with data quality, latency, and completeness checks.

Responsabilités

• Own the Elasticsearch environment ensuring health and scale.
• Own the real-time data pipeline feeding Traffic Dashboard and ensure data quality.
• Monitor performance, detect data gaps, and prevent incidents before users are affected.
• Design changes with testing, monitoring, and rollback strategies.
• Develop data workloads in Databricks and Spark; work with streaming tech like Kafka or Event Hubs.
• Improve observability, scalability, and maintainability of the platform.

Connaissances

Elasticsearch

Databricks

Apache Spark

Kafka

Azure Event Hubs

Real-time data pipelines

Observability

Outils

Elasticsearch

Databricks

Apache Spark

Kafka

Azure Event Hubs

Description du poste

Your impact.

a Senior Data Engineer to take technical ownership of the data foundation behind our Traffic Dashboard.

We believe you could be the perfect fit.

Traffic Dashboard is a business-critical application used daily across our newsrooms. You make sure the real-time data platform behind it remains stable, reliable, efficient and continuously available, allowing our editorial teams to rely on accurate real-time insights throughout the day.

You've already started daydreaming? Keep reading - this opportunity is even better than you imagined!

Taking ownership of our Elasticsearch environment , ensuring it remains healthy, performant and correctly scaled;

Owning the real-time data pipeline feeding Traffic Dashboard and safeguarding data quality, latency and completeness;

Proactively monitoring the platform and investigating performance degradation, data gaps and production incidents before they impact our users;

Designing and implementing reliable changes with appropriate testing, monitoring and rollback strategies;

Further developing our real-time data architecture and APIs , including the integration between Elasticsearch, Databricks and Traffic Dashboard;

Building and productionising data workloads in Databricks and Apache Spark and working with streaming technologies such as Kafka or Azure Event Hubs ;

Improving observability, scalability and maintainability while reducing the operational complexity of the platform.

You are available to work onsite in Antwerp two days per week .

What makes you a great fit?

What's about to become your second home?

You'll join TPS, the international technology organization of Mediahuis . Within this environment, you'll take ownership of the technical foundation behind Traffic Dashboard, a business-critical platform used across our newsrooms. You'll work at the intersection of real-time data, data engineering and application development, collaborating with colleagues to ensure our journalists and editorial teams can rely on fast, complete and accurate data every day.

It's up to you now !