Data Engineer - Remote, Build Robust Data Lakehouse

People Data Labs; Polska; Hybrid; PLN 711,000 - 869,000; Full time

Benefits offered by this job

Stock

Competitive salaries

Unlimited PTO

Medical, dental, and vision insurance

Health, fitness, and office stipends

Remote-friendly environment

Job summary

People Data Labs is seeking a senior Data Engineer to help build scalable data pipelines and entity resolution frameworks across a growing data ecosystem. You will own core ingestion, transformation, and loading workloads, leveraging Spark, Python, SQL, and Databricks to push high-quality data to production.

The role emphasizes autonomous ownership, collaboration, and strong written communication while enabling remote work.

Qualifications

• 3-5+ years of industry experience with clear examples of strategic technical problem-solving and implementation.
• Strong software development fundamentals.
• Experience with Python.
• Expertise with Apache Spark (Java, Scala, and/or Python-based).
• Experience with SQL.
• Experience building scalable data processing systems from the ground up.
• Experience using developer-oriented data pipeline and workflow orchestration (Airflow preferred, dbt, dagster or similar).
• Knowledge of modern data design and storage patterns (incremental updating, partitioning, rebuilds/backfills).
• Experience working in Databricks (delta live tables, data lakehouse patterns).
• Experience with cloud computing services (AWS preferred, GCP, Azure or similar).
• Experience with data warehousing (Databricks, Snowflake, Redshift, BigQuery, or similar).
• Understanding of modern data storage formats and tools (parquet, ORC, Avro, Delta Lake).

Responsibilities

• Build infrastructure for ingestion, transformation, and loading an exponentially increasing volume of data from a variety of sources using Spark, SQL, AWS, and Databricks.
• Building an organic entity resolution framework capable of correctly merging hundreds of billions of individual entities into a number of clean, consumable datasets.
• Developing CI/CD pipelines and anomaly detection systems capable of continuously improving the quality of data we're pushing into production.
• Dreaming up solutions to largely undefined data engineering and data science problems.

Skills

Python

Apache Spark

SQL

Data pipelines

Airflow

dbt

data design

Delta Lake / Databricks

Cloud computing (AWS)

Scala / Java (Spark)

Education

Bachelor's or higher in a quantitative discipline

Tools

Airflow

dbt

dagster

Databricks

Spark (Databricks)

AWS

Job description

People Data Labs is seeking a senior Data Engineer to help build scalable data pipelines and entity resolution frameworks across a growing data ecosystem. You will own core ingestion, transformation, and loading workloads, leveraging Spark, Python, SQL, and Databricks to push high-quality data to production.

The role emphasizes autonomous ownership, collaboration, and strong written communication while enabling remote work.