Data Engineer: Real-Time Pipelines, AI QA, Remote

Rain

New York (NY)

Hybrid

USD 120,000 - 190,000

Full time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Unlimited vacation (min 10 days)
Flexible work location
Home workspace stipend
Health, dental, vision coverage
401(k) with 4% match
Equity plan
Wellness stipend
Office meals
Team offsites

Job summary

Rain is seeking a Data Engineer to join its data platform team in a hybrid US role. You will build scalable batch and streaming pipelines, ingest data from databases, files, APIs and on-chain sources, and ensure data quality and correctness across the warehouse.

You will work with Analytics, Data Science and Risk teams, using tools like dbt, Dagster, Airflow, and cloud warehouses (BigQuery/Snowflake/ClickHouse). The role emphasizes production-grade code and scalable, reusable data solutions.

Qualifications

  • At least 3 years building production data solutions, including end-to-end batch and streaming pipelines.
  • Experience designing data solutions at scale.
  • Strong SQL and Python/Rust, plus cloud data warehouse experience (BigQuery, Snowflake, ClickHouse).
  • Streaming experience with Pub/Sub, Kafka, Dataflow/Beam or Flink.
  • Batch experience with dbt and an orchestrator (Dagster or Airflow).
  • Experience with data quality testing, monitoring, and reconciliation.
  • Ability to debug across source DB, pipelines, warehouse and reports.
  • Willingness to use AI tools to speed up work while validating results.

Responsibilities

  • Build scalable batch and streaming pipelines balancing latency, cost, and correctness.
  • Handle near real-time events with deduplication and late data management.
  • Own ingestion from databases, files, APIs, and onchain sources.
  • Develop dbt models that cope with late data and backfills; reconcile outputs.
  • Orchestrate pipelines with Dagster/Airflow and implement sensors and alerts.
  • Add freshness, volume, and reconciliation checks across sources.
  • Collaborate with Analytics, Data Science and Risk teams to meet data needs.

Skills

SQL
Python
Rust
Data modeling
Data quality
Problem solving

Tools

Dbt
Dagster
Airflow
Pub/Sub
Kafka
Dataflow/Beam
Flink
BigQuery
Snowflake
ClickHouse

Job description

Rain is seeking a Data Engineer to join its data platform team in a hybrid US role. You will build scalable batch and streaming pipelines, ingest data from databases, files, APIs and on-chain sources, and ensure data quality and correctness across the warehouse.

You will work with Analytics, Data Science and Risk teams, using tools like dbt, Dagster, Airflow, and cloud warehouses (BigQuery/Snowflake/ClickHouse). The role emphasizes production-grade code and scalable, reusable data solutions.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer — Real-Time Pipelines & Data Quality
Data Engineer — Real-Time Pipelines & Data Quality

Rain • United States

Hybrid
USD 120,000 - 180,000
Flexible time off
Work from home
Office stipend
+3
Data Engineer - Real-Time & Batch Pipelines (Hybrid)
Data Engineer - Real-Time & Batch Pipelines (Hybrid)

rain • Puerto Rico

Remote
USD 110,000 - 190,000
Flexible time off
Remote-friendly
Home office stipend
+3
Data Engineer - Real-Time Pipelines & Quality at Scale
Data Engineer - Real-Time Pipelines & Quality at Scale

raincards.xyz • San Juan (PR), New York (NY)

Remote
USD 120,000 - 160,000
Unlimited vacation with 10 days min
Flexible work location (home/office)
Home office stipend
+4
Data Engineer: Real-Time & Batch Pipelines
Data Engineer: Real-Time & Batch Pipelines

Solana Teams • San Juan (PR)

Hybrid
USD 120,000 - 190,000
Unlimited vacation with minimum 10‑day
Home office stipend
Health/dental/vision coverage (US)
+3
Data Engineer — Batch & Streaming Pipelines
Data Engineer — Batch & Streaming Pipelines

Hivemind • New York (NY)

Remote
USD 120,000 - 170,000
Health, dental, vision insurance
401(k) with 4% company match
Equity option plan
+3
Data Engineer: Build Real-Time Pipelines & Trustworthy Data
Data Engineer: Build Real-Time Pipelines & Trustworthy Data

Rain • San Juan (PR)

Hybrid
USD 120,000 - 180,000
Unlimited vacation with 10 days min.
Flexible working (home/office) with a设
401(k) with company match
+2
Data Engineer, Cloud Pipelines & AI Infrastructure
Data Engineer, Cloud Pipelines & AI Infrastructure

24-MAG • United States

Remote
USD 140,000 - 180,000
Data Engineer: Cloud Pipelines, AI Tools, Hybrid/Remote
Data Engineer: Cloud Pipelines, AI Tools, Hybrid/Remote

unlockhealth • United States

Hybrid
USD 120,000 - 180,000
Health, dental, and vision benefits
401(k) with company match
Hybrid and remote schedules
+2
Data Engineer (Batch & Streaming) - Hybrid + Equity
Data Engineer (Batch & Streaming) - Hybrid + Equity

Hivemind • United States

Hybrid
USD 150,000 - 190,000
Unlimited vacation
Flexible work
Health/dental/vision 95% covered
+4
Senior Data Engineer: Real-Time Pipelines & Cloud Analytics
Senior Data Engineer: Real-Time Pipelines & Cloud Analytics

Cloudndata • United States

Hybrid
USD 140,000 - 180,000