Senior Data Engineer - Scalable Pipelines & Data Lake

Amo; Paris; On-site; EUR 80,000 - 110,000; Full time

Benefits offered by this job

Health coverage

Parental leave

Vacation 8-9 weeks

Office in central Paris

Company-wide shutdowns

Job summary

amo is seeking a senior data engineer to build and operate batch and streaming data pipelines in Paris. You will move production data into archival storage, improve data quality and observability, and design validations for freshness and schema correctness.

The role includes creating reusable datasets and optimizing queries for performance and cost. The position requires strong Python and SQL skills, production experience with Python or Scala, and familiarity with PySpark, Spark SQL, Spark

Qualifications

• Senior-level experience building and operating data pipelines.
• Proficient in Python and SQL.
• Production experience with Python or Scala.

Responsibilities

• Build and maintain batch and streaming data pipelines.
• Move production data into archival/data lake storage safely.
• Improve quality, reliability, and observability of derived datasets.
• Design validations for freshness, completeness, schema correctness, and data quality.
• Build reusable datasets that reduce one-off data extraction and aggregation work.
• Optimize queries and data processing jobs for correctness, latency, and cost.
• Prototype in the right tools, then integrate scoped production experiments with amo's systems.

Skills

Data pipelines

Python

SQL

PySpark

Spark SQL

Spark Streaming

Parquet

Iceberg

Batch processing

Stream processing

Query optimization

Distributed data systems

Data lakes

Job description

amo is seeking a senior data engineer to build and operate batch and streaming data pipelines in Paris. You will move production data into archival storage, improve data quality and observability, and design validations for freshness and schema correctness.

The role includes creating reusable datasets and optimizing queries for performance and cost. The position requires strong Python and SQL skills, production experience with Python or Scala, and familiarity with PySpark, Spark SQL, Spark