Senior Data Engineer

amo; Paris; Sur place; EUR 70 000 - 110 000; Plein temps

Avantages offerts par ce poste

Onsite 5 days a week

Central Paris office near Opera

Résumé du poste

amo is seeking a senior data engineer to own and operate batch and streaming data pipelines in a production environment in Paris. You will move data into archival storage, improve data quality and observability, and design validations for freshness, completeness, and schema correctness.

You will build reusable datasets and optimize queries for cost and latency. Expect strong Python/SQL skills, production experience with Python or Scala, and familiarity with PySpark, Spark SQL, Spark Streaming,

Qualifications

• Senior-level experience building and operating data pipelines.
• Strong Python and SQL.
• Production experience with Python or Scala.
• Experience with PySpark, Spark SQL, Spark Streaming, Parquet, and Iceberg.
• Strong understanding of batch and stream processing.
• Query optimization experience.
• Familiarity with data engine internals and distributed data systems.
• Experience with data lakes, table/storage formats, and derived datasets.

Responsabilités

• Build and maintain batch and streaming data pipelines.
• Move production data into archival/data lake storage safely and observably.
• Improve quality, reliability, and observability of derived datasets.
• Design validations for freshness, completeness, schema correctness, and data quality.
• Build reusable datasets that reduce one-off data extraction and aggregation work.
• Optimize queries and data processing jobs for correctness, latency, and cost.
• Prototype in the right tools, then integrate scoped production experiments with amo’s systems where needed.

Connaissances

Python

MySQL/SQL

Scala

Distributed data systems

Batch and streaming processing

Query optimization

Data lake/storage

Data pipelines

Outils

PySpark

Spark SQL

Spark Streaming

Parquet

Iceberg

Description du poste

• Build and maintain batch and streaming data pipelines.
• Move production data into archival/data lake storage safely and observably.
• Improve quality, reliability, and observability of derived datasets.
• Design validations for freshness, completeness, schema correctness, and data quality.
• Build reusable datasets that reduce one-off data extraction and aggregation work.
• Optimize queries and data processing jobs for correctness, latency, and cost.
• Prototype in the right tools, then integrate scoped production experiments with amo’s systems where needed.

What You’ll Do

• Build and maintain batch and streaming data pipelines.
• Move production data into archival/data lake storage safely and observably.
• Improve quality, reliability, and observability of derived datasets.
• Design validations for freshness, completeness, schema correctness, and data quality.
• Build reusable datasets that reduce one-off data extraction and aggregation work.
• Optimize queries and data processing jobs for correctness, latency, and cost.
• Prototype in the right tools, then integrate scoped production experiments with amo’s systems where needed.

Must Have

• Senior-level experience building and operating data pipelines.
• Strong Python and SQL.
• Production experience with Python or Scala.
• Experience with PySpark, Spark SQL, Spark Streaming, Parquet, and Iceberg.
• Strong understanding of batch and stream processing.
• Query optimization experience.
• Familiarity with data engine internals and distributed data systems.
• Experience with data lakes, table/storage formats, and derived datasets.

Nice To Have

• Experience with Flink or similar stream processing systems.
• Experience with ML training or inference pipelines.
• Familiarity with ranking, recommendations, embeddings, or entity resolution.
• Experience with privacy-sensitive data systems, GDPR workflows, or data deletion/export pipelines.
• Experience reading or making scoped changes in Rust-backed systems.

Life at amo

To ensure that everyone is set up for success within our way of working, we work together onsite 5 days a week.

We wanted to make sure coming to the office was as comfortable as possible for you:

• We chose a location in central Paris, near Opera (Metro lines 3,8,9 and RER A).
• We have a beautiful Parisian-style office with high ceilings, balconies, and huge windows. So a lot of natural light!

Because life outside of work should also be stress-free, we cover:

We shut down entirely twice a year, two weeks in summer and one week in winter to allow everyone to truly recharge and to avoid prolonged slowdowns (especially in the summer).

These pauses are part of your total vacation time, giving everyone a real chance to unplug and recharge. No Slack, no email, no FOMO.

• Health care (100% coverage).
• Maternity Leave, Paternity Leave, Second Parent Leave (salary maintained at 100%).
• Vacation days: 8-9 weeks (total) per year - (European summer? ).
• 5 weeks of paid time off (by the state);
• 1-2 additional weeks (RTT, based on our company contract);
• ~11 bank holidays.