Data Engineer - Real-Time Pipelines & Quality at Scale

raincards.xyz

San Juan, New York (PR, NY)

Remote

USD 120,000 - 160,000

Full time

7 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Unlimited vacation with 10 days min
Flexible work location (home/office)
Home office stipend
health/dental/vision coverage
401(k) plan with match
Equity option plan
Team summits (domestic and intl)

Job summary

Rain builds payments and stablecoin infrastructure. We seek a Data Engineer with batch and streaming experience to bring data into our warehouse, ensuring accuracy, scalability, and reliability.

You will develop scalable pipelines, handle late and duplicate data, and automate ingestion and quality checks for rapidly onboarded sources. You will work with backend teams, Analytics Engineers, Data Scientists, and Risk to meet data needs, including ML features.

Qualifications

  • 3+ years building production data solutions, end-to-end batch and streaming.
  • Experience designing data solutions at scale.
  • Strong SQL and Python / Rust skills.
  • Experience with cloud data warehouses (BigQuery, Snowflake, ClickHouse).
  • Streaming tools: Pub/Sub, Kafka, Dataflow/Beam, Flink.
  • Batch tooling: dbt and Dagster or Airflow.
  • Production data quality testing, monitoring, and reconciliation.
  • Ability to debug across source, pipeline, warehouse, and reports.
  • Ability to use AI tools to learn and work faster while validating results.

Responsibilities

  • Build scalable batch and streaming pipelines for latency, cost, and correctness.
  • Process events near real time with deduplication and late/out-of-order handling.
  • Own batch ingestion from databases, files, APIs, and onchain sources.
  • Build incremental dbt models handling late data and backfills; reconcile outputs.
  • Orchestrate pipelines in Dagster with sensors, schedules, and alerts.
  • Add freshness, volume, and reconciliation checks to every source and fix root causes.
  • Collaborate with Analytics Engineers, Data Scientists, and Risk on data needs.

Skills

SQL
Python / Rust
Data at scale

Tools

BigQuery
ClickHouse
Snowflake
Pub/Sub
Kafka
Dataflow/Beam
Flink
dbt
Dagster
Airflow
Datastream
Debezium
Meltano
Fivetran
Airbyte
GCP

Job description

Rain builds payments and stablecoin infrastructure. We seek a Data Engineer with batch and streaming experience to bring data into our warehouse, ensuring accuracy, scalability, and reliability.

You will develop scalable pipelines, handle late and duplicate data, and automate ingestion and quality checks for rapidly onboarded sources. You will work with backend teams, Analytics Engineers, Data Scientists, and Risk to meet data needs, including ML features.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer: Build Real-Time Pipelines & Trustworthy Data
Data Engineer: Build Real-Time Pipelines & Trustworthy Data

Rain • San Juan (PR)

Hybrid
USD 120,000 - 180,000
Unlimited vacation with 10 days min.
Flexible working (home/office) with a设
401(k) with company match
+2
Data Engineer: Real-Time & Batch Pipelines
Data Engineer: Real-Time & Batch Pipelines

Solana Teams • San Juan (PR)

Hybrid
USD 120,000 - 190,000
Unlimited vacation with minimum 10‑day
Home office stipend
Health/dental/vision coverage (US)
+3
Data Engineer — Real-Time Pipelines & Data Quality
Data Engineer — Real-Time Pipelines & Data Quality

Rain • United States

Hybrid
USD 120,000 - 180,000
Flexible time off
Work from home
Office stipend
+3
Data Engineer — Batch & Streaming Pipelines
Data Engineer — Batch & Streaming Pipelines

Hivemind • New York (NY)

Remote
USD 120,000 - 170,000
Health, dental, vision insurance
401(k) with 4% company match
Equity option plan
+3
Data Engineer: Real-Time Pipelines, AI QA, Remote
Data Engineer: Real-Time Pipelines, AI QA, Remote

Rain • New York (NY)

Hybrid
USD 120,000 - 190,000
Unlimited vacation (min 10 days)
Flexible work location
Home workspace stipend
+6
Data Engineer - Real-Time Pipelines & Scalable Data
Data Engineer - Real-Time Pipelines & Scalable Data

Rain Xyz • United States

Remote
USD 120,000 - 160,000
Data Engineer - Real-Time & Batch Pipelines (Hybrid)
Data Engineer - Real-Time & Batch Pipelines (Hybrid)

rain • Puerto Rico

Remote
USD 110,000 - 190,000
Flexible time off
Remote-friendly
Home office stipend
+3
Data Engineer (Batch & Streaming) - Hybrid + Equity
Data Engineer (Batch & Streaming) - Hybrid + Equity

Hivemind • United States

Hybrid
USD 150,000 - 190,000
Unlimited vacation
Flexible work
Health/dental/vision 95% covered
+4
Data Platform Engineer — Scale & Govern Data Pipelines
Data Platform Engineer — Scale & Govern Data Pipelines

Rain • New York (NY)

Hybrid
USD 150,000 - 190,000
Unlimited vacation
Flexible work from home
Health/dental/vision 95% coverage
+2
Data Platform Engineer: Cloud, Streaming & ML Pipelines
Data Platform Engineer: Cloud, Streaming & ML Pipelines

Rain • San Juan (PR)

Hybrid
USD 140,000 - 180,000
Unlimited vacation
Flexible working (work from home or in
Home office stipend
+6