Data Engineer: On-Prem Complex Pipelines & Offline-First

MARSS Group; Nice; Sur place; EUR 80 000 - 110 000; Plein temps

Résumé du poste

MARSS Group in Nice, France, is seeking a Data Engineer to join our AI team and build our in-house data platform and pipelines on-premises. You will design and implement data pipelines from the ground up, handling complex data types including images, video and time-series data, with offline-first, air-gapped infrastructure.

You will own data architecture, models and pipelines end-to-end, collaborating with MLOps, DevOps and software engineers to ensure reliability, scalability and data quality

Qualifications

• Strong professional experience in a closely related data engineering role.
• Designing and implementing data pipelines from zero (not cloud-based).
• Proficiency in Python and SQL.
• Experience with multiple data types (images, video, sensor data, time-series).
• Offline-first architectures and edge/infrastructure handling.
• Experience with bare metal or self-managed servers.
• Knowledge of data ingestion, transformation, storage, validation and quality principles.
• Experience with large/complex datasets.
• Strong Linux skills and network troubleshooting.
• Good software engineering practices: Git, testing, code review, documentation.

Responsabilités

• Design and build data pipelines from scratch, from ingestion through processing, transformation, storage and consumption.
• Design ingestion for offline/disconnected nodes with local buffering, resumable transfer and late data reconciliation.
• Define data prioritization with ML team during bandwidth windows.
• Handle multiple data types: structured/tabular data, images, video and time-series.
• Work with sensor data including timestamp sequencing and clock drift management.
• Develop robust Python/SQL processing solutions.
• Design data models and storage with capacity planning for large image/video data on self-managed storage.
• Own workflow definitions in the orchestration layer, including retry, idempotency and backfill behaviour.
• Build processes for ingestion, transformation, validation, quality control and traceability.
• Collaborate with MLOps, DevOps and Software Engineers to meet data requirements.
• Ensure pipelines are reliable, maintainable and scalable as volumes grow.
• Identify data-quality issues and define monitoring with the MLOps Engineer.
• Define overall architecture and standards for the in-house data platform.
• Document pipeline architecture, data flows and technical solutions.

Connaissances

Python

SQL

Data pipelines

Linux

Git

Testing

Documentation

Offline-first

Edge computing

Description du poste

MARSS Group in Nice, France, is seeking a Data Engineer to join our AI team and build our in-house data platform and pipelines on-premises. You will design and implement data pipelines from the ground up, handling complex data types including images, video and time-series data, with offline-first, air-gapped infrastructure.

You will own data architecture, models and pipelines end-to-end, collaborating with MLOps, DevOps and software engineers to ensure reliability, scalability and data quality