Remote Senior Data Engineer - End-to-End Data Platform

Clera Labs, Inc.; EE. UU.; A distancia; USD 120.000 - 160.000; Jornada completa

Descripción de la vacante

Fundable is seeking a Senior Data Engineer to own a remote, LATAM-based data platform from architecture to production. You will handle ingestion from APIs, webhooks, files, and scraping, building robust, scalable pipelines and event-driven systems with modern orchestration and validation.

You will work with SQL/PostgreSQL, Python, dbt, and GCP to deliver reliable, curated data for product intelligence. No strict working-hours overlap required; remote collaboration across regions is expected.

Formación

• 5+ years building and operating multi-source production data platforms.
• Experience with production workflow orchestration (Airflow, Dagster, Prefect, Temporal) including retries and failure recovery.
• Hands-on dbt, GCP experience including BigQuery and storage.
• Strong SQL and PostgreSQL data modeling and loading patterns.
• Strong Python skills including asynchronous HTTP and concurrent processing.

Responsabilidades

• Design and build a multi-source data platform supporting concurrent ingestion and batch workflows.
• Implement concurrent intake for APIs, webhooks, files, and scraping with robust failure handling.
• Orchestrate scheduled workflows and historical backfills with tools like Airflow, Dagster, or Prefect.
• Build event-driven systems with Pub/Sub or Cloud Tasks, including retries and replay control.
• Preserve payloads in Cloud Storage and transform with dbt into medallion layers (raw, standardized, curated).
• Implement upserts and safe retries to prevent duplicates and data corruption.
• Define data contracts, automated validation, and pipeline tests; monitor freshness and failures.
• Design and optimize PostgreSQL schemas and loading patterns for downstream consumption.
• Integrate provider enrichment and LLM-based structured extraction into the platform.

Conocimientos

SQL

Python

Data modeling

Asynchronous processing

Data quality

Herramientas

Airflow

Dagster

Prefect

Temporal

dbt

Google Cloud Platform

PostgreSQL

Pub/Sub

Cloud Tasks

BigQuery

Scrapy

Playwright

Descripción del empleo

Fundable is seeking a Senior Data Engineer to own a remote, LATAM-based data platform from architecture to production. You will handle ingestion from APIs, webhooks, files, and scraping, building robust, scalable pipelines and event-driven systems with modern orchestration and validation.

You will work with SQL/PostgreSQL, Python, dbt, and GCP to deliver reliable, curated data for product intelligence. No strict working-hours overlap required; remote collaboration across regions is expected.