Senior Data Engineer (Fully Remote)

Fundable LLC; United States; Remote; USD 120,000 - 160,000; Full time

Job summary

Fundable LLC in the United States is seeking a data engineer to build concurrent ingestion for provider APIs, webhooks, files, and scraping with robust rate limits and failure handling. You will orchestrate scheduled workflows with Airflow, Dagster, or Prefect, implement event-driven intake with Pub/Sub or Cloud Tasks, and ensure data quality through validation and testing.

Join a small engineering team focused on reliable data infrastructure and scalable PostgreSQL schemas for downstream

Qualifications

• Experience designing reliable data ingestion pipelines with multiple data sources.
• Ability to implement idempotent processing and safe retries for backfills.
• Familiarity with data contracts, automated validation, and pipeline tests.

Responsibilities

• Build concurrent ingestion for provider APIs, webhooks, files, and scraping with rate limits and failure handling.
• Orchestrate scheduled workflows and historical backfills using Airflow, Dagster, or Prefect.
• Implement event-driven intake with Pub/Sub or Cloud Tasks including retries and dead-letter queues.
• Design and optimize PostgreSQL schemas and queries for downstream products.

Skills

Airflow

Dagster

Prefect

Pub/Sub

Cloud Tasks

Backfills

Retry strategies

Tools

dbt

PostgreSQL

Google Cloud Storage

Job description

• Build concurrent ingestion for provider APIs, webhooks, files, and scraping with rate limits and failure handling.
• Orchestrate scheduled workflows and historical backfills using Airflow, Dagster, or Prefect.
• Implement event-driven intake with Pub/Sub or Cloud Tasks including retries and dead-letter queues.

Raw-to-curated data:

• Preserve original payloads in GCS before transforming with dbt.
• Establish medallion layers for raw, standardized, and curated data.

Correctness through recovery:

• Implement idempotent upserts and safe retries, replay, and backfills without duplicates.
• Make data traceable and safe to reprocess.

Data quality and delivery:

• Define data contracts, build automated validation and pipeline tests.
• Design and optimize PostgreSQL schemas and queries for downstream products.

Fundable

Fundable is a startup data platform that helps investors and teams discover and research companies. It is a small engineering team with broad ownership and a focus on building reliable data infrastructure.