Data Engineer

Jobtailor; Paris; Sur place; EUR 90 000 - 120 000; Plein temps

Résumé du poste

Jobtailor seeks a senior data platform engineer to design, ship and operate production data pipelines across batch, streaming and reporting stacks. You will shape petabyte-scale storage and compute strategies using Iceberg, Spark, DuckDB, and Trino, and own the data contracts behind the Clear UI.

You will own incident response, on-call duties, cost and latency optimizations, and drive cross-functional collaboration with analytics, engineering, and product teams.

Qualifications

• 5+ years building and operating production data platforms at real volume.
• Deep lakehouse experience across storage and compute.
• Production experience with a modern orchestrator plus dbt or equivalent.
• Proven track record of handling large data volumes under time and cost constraints.
• Operational ownership: on-call, incident response, alerts and runbooks.
• Strong cross-functional communication.

Responsabilités

• Ship and operate production pipelines across batch, streaming, and reporting stacks, from requirements to monitoring.
• Design storage and compute for petabyte-scale datasets using Iceberg, Spark, DuckDB, and Trino.
• Cut cost and latency on specific pipelines and queries, with quantified, instrumented impact.
• Own the data contract for the ClickHouse and Cube reporting stack behind the Clear UI.
• Build alerts, SLOs, and runbooks so fewer incidents reach users.
• Lead incident response and carry on-call across production systems.
• Influence upstream producers on schemas, semantics, and SLAs for bid, win, and impression events.
• Build tooling, conventions, and data contracts that make the whole team faster.

Connaissances

Production data platforms

Lakehouse experience

Orchestrators

dbt experience

Incident response

Cross-functional communication

Outils

Iceberg

Delta

Hudi

Spark

DuckDB

Trino

Dagster

Airflow

Prefect

dbt

Description du poste

Responsibilities

• Ship and operate production pipelines across batch, streaming, and reporting stacks, from requirements to monitoring
• Design storage and compute for petabyte-scale datasets using Iceberg, Spark, DuckDB, and Trino
• Cut cost and latency on specific pipelines and queries, with quantified, instrumented impact
• Own the data contract for the ClickHouse and Cube reporting stack behind the Clear UI
• Build alerts, SLOs, and runbooks so fewer incidents reach users
• Lead incident response and carry on-call across production systems
• Influence upstream producers on schemas, semantics, and SLAs for bid, win, and impression events
• Build tooling, conventions, and data contracts that make the whole team faster

Requirements

• 5+ years building and operating production data platforms at real volume, not analytics or BI‑adjacent work.
• Deep lakehouse experience across storage (Iceberg, Delta, or Hudi) and compute (Spark, DuckDB, or Trino)
• Production experience with a modern orchestrator (Dagster, Airflow, or Prefect) plus dbt or an equivalent transformation framework
• A proven track record of handling large volumes of data under time and cost constraints.
• Operational ownership: on-call, incident response, alerts and runbooks you actually wrote
• Cross‑functional communication: you adapt detail to the audience and push back on stakeholders constructively