Senior Data Engineer

Clera

United States

Remote

USD 120,000 - 160,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Royper Royco LLC is seeking a platform engineer to own a data and infrastructure platform from ingestion to production. You will design a multi-source data platform, ingest from APIs, webhooks, files, and web scraping, and orchestrate workflows with Airflow or Dagster.

You will build event-driven systems, store payloads in Google Cloud Storage, transform data with dbt, implement data contracts, validation, and monitoring, and optimize PostgreSQL schemas while enabling LLM-based extraction.

Qualifications

  • 5+ years building and operating production data platforms across multiple sources.
  • Production experience with workflow orchestration (Airflow preferred).
  • Hands-on with dbt and Google Cloud Platform.
  • Strong Python skills incl. async HTTP and concurrent processing.
  • Strong SQL/PostgreSQL data modeling and incremental loading.
  • Experience with event-driven systems and data storage/retention policies.

Responsibilities

  • Design and build a multi-source data platform for concurrent ingestion, event-driven processing, and orchestrated batch workflows.
  • Ingest data from APIs, webhooks, files, and web scraping with rate limits and robust failure handling.
  • Orchestrate scheduled workflows and historical backfills using Airflow, Dagster, Prefect, or comparable tools.
  • Build event-driven systems with messaging or queues, including retries and dead-letter queues.
  • Store original payloads in Google Cloud Storage and transform data with dbt into raw, standardized, and curated layers.
  • Implement idempotent upserts, data contracts, validation, pipeline tests, retention policies, and monitoring for freshness and failures.
  • Design and optimize PostgreSQL schemas and loading patterns, and integrate data enrichment and LLM-based extraction.

Skills

Python asyncio
SQL PostgreSQL
Airflow Dagster
GCP Google Cloud
dbt
Web scraping
Data modeling
ETL design

Tools

Airflow
Dagster
dbt
Prefect
BigQuery

Job description

Join a data and infrastructure team building a platform that turns information from multiple sources into reliable, current company intelligence. You will own the platform end to end, from ingestion and architecture to production operations, powering downstream products with trusted data.

What You'll Do
  • Design and build a multi-source data platform for concurrent ingestion, event-driven processing, and orchestrated batch workflows.
  • Ingest data from APIs, webhooks, files, and web scraping with rate limits and robust failure handling.
  • Orchestrate scheduled workflows and historical backfills using Airflow, Dagster, Prefect, or comparable tools.
  • Build event-driven systems with messaging or task queues, including retries, dead-letter queues, and controlled replay.
  • Store original payloads in Google Cloud Storage and transform data with dbt into raw, standardized, and curated layers.
  • Implement idempotent upserts, data contracts, validation, pipeline tests, retention policies, and monitoring for freshness and failures.
  • Design and optimize PostgreSQL schemas and loading patterns, and integrate data enrichment and LLM-based structured extraction.
What We're Looking For
  • At least 5 years building and operating production data platforms across multiple sources, with ownership from architecture through deployment and ongoing operations.
  • Production experience with workflow orchestration, including dependencies, retries, and failure recovery. Airflow is preferred; Dagster, Prefect, Temporal, or comparable tools are relevant.
  • Hands-on production experience with dbt and Google Cloud Platform.
  • Strong Python skills, including asynchronous HTTP and concurrent processing with asyncio, aiohttp, HTTPX, or similar tools.
  • Strong SQL and PostgreSQL skills, including data modeling, query optimization, and incremental loading.
  • Experience with event-driven systems, messaging or task queues, asynchronous processing, and recovery from failures.
  • Experience with raw and curated data storage, data contracts, retention, automated validation, pipeline testing, and monitoring.
  • Web scraping, entity resolution, data enrichment, BigQuery, Dataform, and LLM-based extraction experience are useful. Experience building platforms from scratch or working in small, fast-moving teams is also valued.

Base salary: $120,000 to $160,000 annually. Visa sponsorship is not available.

Location

Remote within the United States. New York-based candidates are welcome, but New York residency is not required.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer (Remote - US only)
Senior Data Engineer (Remote - US only)

IllTip • New York (NY)

Hybrid
USD 120,000 - 165,000
Senior Data Engineer
Senior Data Engineer

Aitomic Jobs • United States

Remote
USD 120,000 - 160,000
Data Platform Engineer (Fully Remote)
Data Platform Engineer (Fully Remote)

Unknown • United States

Remote
USD 140,000 - 200,000
Visa sponsorship not available
Fundable - Senior Data Engineer
Fundable - Senior Data Engineer

silver • United States

Remote
USD 140,000 - 180,000
Fundable Senior Data Engineer — LATAM
Fundable Senior Data Engineer — LATAM

Clera Labs, Inc. • United States

Remote
USD 120,000 - 160,000
Senior Data Engineer
Senior Data Engineer

7Seventy • New York (NY)

Hybrid
USD 160,000 - 180,000
Employer 401(k) match
Wellness stipend
Remote-friendly, optional NYC office
+1
Senior Data Engineer
Senior Data Engineer

Zoominfo • United States

Remote
USD 110,000 - 170,000
Remote work
Senior Data Engineer
Senior Data Engineer

Galaxy Software, Inc. • New York (NY)

On-site
USD 170,000 - 200,000
Health coverage
Flexible PTO
Paid holidays
Senior Data Engineer
Senior Data Engineer

Yablon & Associates LLC • New York (NY)

On-site
USD 120,000 - 160,000
Senior Data Engineer
Senior Data Engineer

Silver.dev • United States

Remote
USD 140,000 - 200,000