Senior Data Pipeline Architect — Paris Onsite

amo; Paris; Sur place; EUR 75 000 - 115 000; Plein temps

Avantages offerts par ce poste

Health care 100% coverage

Office in central Paris near Opera

Long vacation entitlement (8–9 weeks)

Résumé du poste

amo is seeking a senior data engineer to build and operate robust data pipelines in Paris. The role focuses on batch and streaming processing, data lake storage, and producing high-quality, observable datasets.

You will optimize queries, validate data quality, and integrate production experiments within amo’s systems. The ideal candidate has strong Python/SQL skills, production experience with Python or Scala, and hands-on experience with PySpark, Spark SQL, Spark Streaming, Parquet and Iceberg.

Qualifications

• Senior experience building and operating data pipelines.
• Proficient in Python and SQL.
• Production experience with Python or Scala.
• Experience with PySpark, Spark SQL, Spark Streaming, Parquet, and Iceberg.
• Strong understanding of batch and stream processing.
• Experience with query optimization.
• Familiarity with data engine internals and distributed data systems.
• Experience with data lakes, table/storage formats, and derived datasets.

Responsabilités

• Build and maintain batch and streaming data pipelines.
• Move production data into archival/data lake storage safely and observably.
• Improve quality, reliability, and observability of derived datasets.
• Design validations for freshness, completeness, schema correctness, and data quality.
• Build reusable datasets to reduce one-off data extraction and aggregation work.
• Optimize queries and data processing jobs for correctness, latency, and cost.
• Prototype in the right tools, then integrate scoped production experiments with amo’s systems where needed.

Connaissances

Senior data pipeline engineering

Python

SQL

Production experience with Python/Scal

Batch and stream processing

Query optimization

Distributed data systems

Data lakes & storage formats

Flink or similar stream processing

ML training/inference pipelines

Ranking/recommendations/embeddings

GDPR workflows / data privacy

Rust

Formation

Bachelor's degree preferred

Outils

PySpark

Spark SQL

Spark Streaming

Parquet

Iceberg

Scala

Description du poste

amo is seeking a senior data engineer to build and operate robust data pipelines in Paris. The role focuses on batch and streaming processing, data lake storage, and producing high-quality, observable datasets.

You will optimize queries, validate data quality, and integrate production experiments within amo’s systems. The ideal candidate has strong Python/SQL skills, production experience with Python or Scala, and hands-on experience with PySpark, Spark SQL, Spark Streaming, Parquet and Iceberg.