Data Platform Engineer

European Tech Recruit; Brussel; Hybride; EUR 70 000 - 100 000; Plein temps

Avantages offerts par ce poste

Hybrid work

Résumé du poste

European Tech Recruit seeks a Data Platform Engineer to own the end-to-end platform powering automotive AI initiatives. You will design and operate workflows for video ingestion, metadata, GDPR compliance and dataset versioning, enabling reproducible ML experiments.

You'll build scalable pipelines, robust relational data models, APIs and dashboards that monitor data quality, usage and compliance. Collaboration with software, data science and product teams is essential to deliver secure,

Qualifications

• Strong data engineering and pipeline experience.
• Excellent relational database design skills.
• Proficient in Python for automation and APIs.

Responsabilités

• Build automated video ingestion and processing pipelines, including validation, metadata extraction and deduplication
• Design robust relational data models and metadata catalogues
• Implement GDPR and consent management, audit trails, retention and automated notifications
• Establish dataset versioning and reproducibility across ML experiments
• Build APIs and interfaces for data input, browsing and management
• Develop dashboards covering data quality, dataset usage, compliance and operational metrics
• Ensure traceability aligns with ASPICE and integrate with Codebeamer
• Deploy and operate the platform securely, including appropriate isolation of sensitive data
• Occasionally support data collection and in-car testing

Connaissances

Data engineering

Relational DB design

Python

Large media datasets

Data dashboards

GDPR handling

ML dataset lifecycles

Communication

Description du poste

Data Platform Engineer | Video, Data & ML | Python

Contract - Excellent Rates - Hybrid

Build the data platform powering the next generation of automotive AI.

We’re looking for a Data Platform Engineer to own the end-to-end platform managing a large and growing collection of video data used for Machine Learning.

You’ll replace ad-hoc file sharing and manual processes with a governed, automated and reproducible data platform covering ingestion, storage, metadata, dataset versioning, GDPR/consent management, processing pipelines and reporting.

What You’ll Do

• Build automated video ingestion and processing pipelines, including validation, metadata extraction and deduplication
• Design robust relational data models and metadata catalogues
• Implement GDPR and consent management, audit trails, retention and automated notifications
• Establish dataset versioning and reproducibility across ML experiments
• Build APIs and interfaces for data input, browsing and management
• Develop dashboards covering data quality, dataset usage, compliance and operational metrics
• Ensure traceability aligns with ASPICE and integrate with Codebeamer
• Deploy and operate the platform securely, including appropriate isolation of sensitive data
• Occasionally support data collection and in-car testing

What We’re Looking For

• Strong Data Engineering and data pipeline experience
• Excellent relational database design and modelling skills
• Strong Python for automation, pipelines and API development
• Experience handling large media/binary datasets and object storage
• Experience building data dashboards and reporting
• Practical understanding of GDPR, PII, consent and data retention
• Understanding of ML dataset lifecycles and visual-data workflows
• Excellent communication and collaboration skills