Foundational Data Engineer – Multimodal ML Pipelines

Harmattan AI

Paris

On-site

EUR 90,000 - 140,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Harmattan AI is seeking a Data Engineer on the Foundational team in Paris to build massive data infrastructure for deep learning models. You will manage terabytes—soon petabytes—of EO and IR video data, ensuring data pipelines are robust and performant so ML engineers can focus on model design.

You will implement high-throughput loading, synchronization of EO/IR frames, and scalable processing using Spark, Ray, or Beam, while optimizing storage and data quality.

Qualifications

  • BS or MS in CS, SE, or distributed systems preferred.
  • 5–6+ years building terabyte-scale pipelines for unstructured data.
  • Proven track record in maximizing multi-node GPU utilisation.

Responsibilities

  • Build ETL/ELT pipelines to ingest EO/IR video into optimized formats.
  • Develop algorithms for EO/IR frame synchronization.
  • Architect storage-to-GPU pipelines for multi-node training clusters.
  • Write distributed data processing jobs with Spark, Ray, or Beam.
  • Implement automated data quality checks and reproducible training with versioning.
  • Evaluate storage solutions (MinIO, S3 tiering) for cost and latency.

Skills

Distributed systems
Parallel computing
GPU utilisation
Data engineering

Education

BS/MS in Computer Science or Distributed Systems

Tools

Spark
Ray
Beam
DVC
Iceberg
Pachyderm
MinIO
S3

Job description

Harmattan AI is seeking a Data Engineer on the Foundational team in Paris to build massive data infrastructure for deep learning models. You will manage terabytes—soon petabytes—of EO and IR video data, ensuring data pipelines are robust and performant so ML engineers can focus on model design.

You will implement high-throughput loading, synchronization of EO/IR frames, and scalable processing using Spark, Ray, or Beam, while optimizing storage and data quality.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Foundational Data Engineer - High-Volume Video Pipelines
Foundational Data Engineer - High-Volume Video Pipelines

Harmattan AI • Paris

On-site
EUR 70,000 - 90,000
Data Engineer — ML Data Pipelines for Autonomous Defense
Data Engineer — ML Data Pipelines for Autonomous Defense

Signal Processing Engineer (RF Processing & Analytics) • Paris

On-site
EUR 60,000 - 90,000
Data Engineer - Foundational
Data Engineer - Foundational

Harmattan AI • Paris

On-site
EUR 70,000 - 90,000
Data Engineer - Foundational
Data Engineer - Foundational

Harmattan AI • Paris

On-site
EUR 90,000 - 140,000
Data Engineer: Build Multimodal, Training-Ready Datasets
Data Engineer: Build Multimodal, Training-Ready Datasets

Harmattan AI • Paris

On-site
EUR 70,000 - 95,000
AI Data Engineer – Pipelines & ML Training (Remote)
AI Data Engineer – Pipelines & ML Training (Remote)

Speechify Inc. • Lille

Hybrid
EUR 27,000 - 89,000
Remote-friendly
Stock options
Flexible schedule
Senior Data Infrastructure Engineer - Petabyte AI Pipelines
Senior Data Infrastructure Engineer - Petabyte AI Pipelines

Genesis • Paris

On-site
EUR 120,000 - 180,000
Data Engineer for AI-Powered Data Pipelines
Data Engineer for AI-Powered Data Pipelines

McKinsey • Paris

Hybrid
EUR 70,000 - 110,000
Data Engineer (Detect & Track Distillation)
Data Engineer (Detect & Track Distillation)

Signal Processing Engineer (RF Processing & Analytics) • Paris

On-site
EUR 60,000 - 90,000
Data Engineer (Detect & Track Distillation)
Data Engineer (Detect & Track Distillation)

Harmattan AI • Paris

On-site
EUR 70,000 - 95,000