Senior Data Platform Engineer — Remote

TechTree; Polska; Hybrid; PLN 180,000 - 300,000; Full time

Job summary

TechTree seeks a senior data engineer to own our data platform from architecture through production, turning high volumes of data from provider APIs, webhooks, files, and web scraping into trusted records for our products. You’ll lead the move to a platform that supports concurrent processing, event-driven intake, and orchestrated batch workflows.

Responsibilities include multi-source ingestion, batch and event-driven execution with Airflow/Dagster/Prefect/Temporal, raw-to-curated data in GCS

Qualifications

• Experience building multi-source production data platforms from zero to one.
• Production experience with workflow orchestration tools such as Airflow, Dagster, Prefect, or Temporal.
• Hands-on production experience with dbt and GCP.
• Experience building event-driven systems with messaging or task queues.
• Strong SQL and PostgreSQL skills, including data modeling and reliable incremental loading.
• Strong Python skills, including asynchronous HTTP and concurrent processing.
• Hands-on web scraping experience with Scrapy, Playwright, Selenium, or Beautiful Soup.
• Nice-to-have: startup experience, entity resolution, LLM-based extraction, BigQuery/Dataform.

Responsibilities

• Own data platform architecture and production operations.
• Build concurrent ingestion from providers (APIs, webhooks, files, scraping) with rate limits and failure handling.
• Orchestrate batch and event-driven workflows using Airflow, Dagster, Prefect, or Temporal.
• Preserve raw payloads in storage and transform with dbt, establishing medallion layers.
• Ensure data quality with automated tests and contracts; monitor freshness and failures.
• Design PostgreSQL schemas and loading patterns for downstream products.
• Integrate provider enrichment and LLM-based extraction into the platform.

Skills

SQL & PostgreSQL

Python

Asynchronous processing

Data modeling

Data contracts

Quality checks

Tools

Airflow

Dagster

Prefect

Temporal

dbt

GCP

Pub/Sub

Cloud Tasks

Beautiful Soup

Scrapy

Playwright

Selenium

Job description

TechTree seeks a senior data engineer to own our data platform from architecture through production, turning high volumes of data from provider APIs, webhooks, files, and web scraping into trusted records for our products. You’ll lead the move to a platform that supports concurrent processing, event-driven intake, and orchestrated batch workflows.

Responsibilities include multi-source ingestion, batch and event-driven execution with Airflow/Dagster/Prefect/Temporal, raw-to-curated data in GCS