Senior Data Engineer - Multi-Source Data Platform Lead

Silver.dev

United States

Remote

USD 140,000 - 200,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Fundable is seeking a senior data engineer to own its data platform from architecture to production. You’ll turn data from APIs, webhooks, files and scraping into trusted records, with concurrent processing and event-driven intake.

You’ll implement multi-source ingestion, orchestrate workflows with Airflow or Dagster, design robust data pipelines in GCS and dbt, and ensure data quality and traceability for product teams.

Qualifications

  • Experience building multi-source production data platforms from zero to one.
  • Production experience with workflow orchestration tools (Airflow, Dagster, Prefect, Temporal).
  • Hands-on dbt and GCP experience.
  • Experience building event-driven systems with messaging or queues, including asynchronous processing and failure recovery.
  • Strong SQL and PostgreSQL skills, including data modeling and reliable incremental loading.
  • Strong Python skills including asynchronous HTTP and concurrent processing.
  • Hands-on web scraping with Scrapy, Playwright, Selenium, or Beautiful Soup, with concurrency and rate limits.

Responsibilities

  • Build concurrent ingestion for provider APIs, webhooks, files, and scraping, with rate limits and failure handling.
  • Orchestrate scheduled workflows and historical backfills using Airflow, Dagster, or Prefect; build event-driven intake with Pub/Sub or Cloud Tasks.
  • Preserve raw payloads in Google Cloud Storage (GCS) before transforming with dbt; establish medallion layers for raw, standardized, and curated data.
  • Implement idempotent upserts and safe retries, replay, and historical backfills to avoid duplicates and data corruption; ensure traceability.
  • Define data contracts, build automated validation and pipeline tests, and monitor freshness and failures; optimize PostgreSQL schemas and loading patterns.
  • Integrate provider enrichment and LLM-based structured extraction into the platform.

Skills

SQL
PostgreSQL
Python
asyncio
concurrent processing
data contracts
data modeling

Tools

dbt
GCP
Airflow
Dagster
Prefect
Temporal
Pub/Sub
Cloud Tasks
Playwright
Scrapy
Selenium
Beautiful Soup

Job description

Fundable is seeking a senior data engineer to own its data platform from architecture to production. You’ll turn data from APIs, webhooks, files and scraping into trusted records, with concurrent processing and event-driven intake.

You’ll implement multi-source ingestion, orchestrate workflows with Airflow or Dagster, design robust data pipelines in GCS and dbt, and ensure data quality and traceability for product teams.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

Silver.dev • United States

Remote
USD 140,000 - 200,000
Remote Senior Data Engineer - End-to-End Data Platform
Remote Senior Data Engineer - End-to-End Data Platform

Clera Labs, Inc. • United States

Remote
USD 120,000 - 160,000
Senior Data Engineer (Fully Remote)
Senior Data Engineer (Fully Remote)

Fundable LLC • United States

Remote
USD 120,000 - 160,000
Senior Data Engineer: Scalable Ingestion & Data Quality
Senior Data Engineer: Scalable Ingestion & Data Quality

Fundable LLC • United States

Remote
USD 120,000 - 160,000
Fundable - Senior Data Engineer
Fundable - Senior Data Engineer

silver • United States

Remote
USD 140,000 - 180,000
Fundable Senior Data Engineer — LATAM
Fundable Senior Data Engineer — LATAM

Clera Labs, Inc. • United States

Remote
USD 120,000 - 160,000
Senior Data Engineer
Senior Data Engineer

Clera • United States

Remote
USD 120,000 - 160,000
Senior Data Platform Engineer
Senior Data Platform Engineer

Harnham • Los Angeles (CA)

On-site
USD 120,000 - 150,000
Senior Data Platform Engineer: Ingest, Orchestrate & Scale
Senior Data Platform Engineer: Ingest, Orchestrate & Scale

silver • United States

Remote
USD 140,000 - 180,000
Senior Data Platform Architect & Tech Coach
Senior Data Platform Architect & Tech Coach

Strategic Employment Partners (SEP, Inc.) • San Francisco (CA)

On-site
USD 200,000 - 230,000
Equity
Top-tier benefits