Senior Data Engineer: Pipelines, Lake Storage & Data Quality

United States Digital Space LLC; Paris; Sur place; EUR 70 000 - 110 000; Plein temps

Avantages offerts par ce poste

Health insurance 100%

Generous PTO (8-9 weeks)

Parental leave (Maternity/Paternity/2P

Office in central Paris

Résumé du poste

United States Digital Space LLC is seeking a Senior Data Engineer to design and operate batch and streaming data pipelines in Paris. The role focuses on moving production data to archival storage, building reusable datasets, and optimizing queries for cost and latency.

You will work with PySpark, Spark SQL, and Iceberg within a data-driven environment. The position is onsite in Paris, France, with a strong emphasis on data quality, observability, and scalable architectures.

Qualifications

• Senior-level experience building and operating data pipelines.
• Strong Python and SQL.

Responsabilités

• Build and maintain batch and streaming data pipelines.
• Move production data into archival/data lake storage safely and observably.
• Improve quality, reliability, and observability of derived datasets.
• Design validations for freshness, completeness, schema correctness, and data quality.
• Build reusable datasets that reduce one-off data extraction and aggregation work.
• Optimize queries and data processing jobs for correctness, latency, and cost.
• Prototype in the right tools, then integrate scoped production experiments with the company’s systems where needed.

Connaissances

Senior data pipelines

Python

SQL

PySpark

Spark SQL

Spark Streaming

Parquet

Iceberg

Data lakes

Data quality

Query optimization

Distributed systems

Outils

Flink

Rust

Description du poste

United States Digital Space LLC is seeking a Senior Data Engineer to design and operate batch and streaming data pipelines in Paris. The role focuses on moving production data to archival storage, building reusable datasets, and optimizing queries for cost and latency.

You will work with PySpark, Spark SQL, and Iceberg within a data-driven environment. The position is onsite in Paris, France, with a strong emphasis on data quality, observability, and scalable architectures.