Data Engineer - Real-Time & Batch Pipelines (Hybrid)

rain

Puerto Rico

Remote

USD 110,000 - 190,000

Full time

7 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Flexible time off
Remote-friendly
Home office stipend
Healthcare benefits
401(k) match
Equity

Job summary

Rain is pursuing a Data Engineer to join our data warehouse team. You will design and maintain batch and streaming pipelines that ingest data from databases, files, APIs, and on-chain sources, ensuring accuracy and timeliness.

In this role you will build dbt models, orchestrate with Dagster, and collaborate with Analytics Engineers, Data Scientists, and Risk to deliver reliable data for decision making. Remote-friendly with flexible time off and equity.

Qualifications

  • At least 3 years building production data solutions, including owning both batch and streaming pipelines end to end, from source to warehouse.
  • Experience designing data solutions at scale.
  • Strong SQL and Python; plus experience with a cloud data warehouse such as BigQuery and an understanding of their trade-offs.
  • Streaming experience with Pub/Sub, Kafka, Dataflow/Beam, or Flink.
  • Batch experience with dbt and an orchestrator such as Dagster or Airflow.
  • Experience with production data quality testing, monitoring, and reconciliation.
  • Ability to debug across the source database, pipeline, warehouse, and report.
  • Ability to use AI tools to learn and work faster while checking their output.

Responsibilities

  • Build scalable batch and streaming pipelines, choosing the right approach for latency, cost, and correctness.
  • Process events near real time, handling deduplication, windowing, and late or out-of-order events.
  • Own batch ingestion from databases (CDC), files (SFTP and GCS), APIs, and onchain sources.
  • Build incremental dbt models that handle late data, duplicates, CDC deletes, and backfills; reconcile streaming and batch outputs.
  • Orchestrate pipelines in Dagster with sensors, schedules, and alerts.
  • Add freshness, volume, and reconciliation checks to every source, and fix root causes.
  • Work with backend pods on event and table contracts to prevent downstream breakage.
  • Partner with Analytics Engineers, Data Scientists, and Risk on their data needs, including ML features.

Skills

SQL
Python
Data engineering

Tools

BigQuery
Dagster
Airflow
Pub/Sub
Kafka

Job description

Rain is pursuing a Data Engineer to join our data warehouse team. You will design and maintain batch and streaming pipelines that ingest data from databases, files, APIs, and on-chain sources, ensuring accuracy and timeliness.

In this role you will build dbt models, orchestrate with Dagster, and collaborate with Analytics Engineers, Data Scientists, and Risk to deliver reliable data for decision making. Remote-friendly with flexible time off and equity.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer: Real-Time Pipelines, AI QA, Remote
Data Engineer: Real-Time Pipelines, AI QA, Remote

Rain • New York (NY)

Hybrid
USD 120,000 - 190,000
Unlimited vacation (min 10 days)
Flexible work location
Home workspace stipend
+6
Data Engineer — Real-Time Pipelines & Data Quality
Data Engineer — Real-Time Pipelines & Data Quality

Rain • United States

Hybrid
USD 120,000 - 180,000
Flexible time off
Work from home
Office stipend
+3
Data Engineer (Batch & Streaming) - Hybrid + Equity
Data Engineer (Batch & Streaming) - Hybrid + Equity

Hivemind • United States

Hybrid
USD 150,000 - 190,000
Unlimited vacation
Flexible work
Health/dental/vision 95% covered
+4
Data Engineer: Real-Time & Batch Pipelines
Data Engineer: Real-Time & Batch Pipelines

Solana Teams • San Juan (PR)

Hybrid
USD 120,000 - 190,000
Unlimited vacation with minimum 10‑day
Home office stipend
Health/dental/vision coverage (US)
+3
Data Engineer — Batch & Streaming Pipelines
Data Engineer — Batch & Streaming Pipelines

Hivemind • New York (NY)

Remote
USD 120,000 - 170,000
Health, dental, vision insurance
401(k) with 4% company match
Equity option plan
+3
Data Engineer - Real-Time Pipelines & Quality at Scale
Data Engineer - Real-Time Pipelines & Quality at Scale

raincards.xyz • San Juan (PR), New York (NY)

Remote
USD 120,000 - 160,000
Unlimited vacation with 10 days min
Flexible work location (home/office)
Home office stipend
+4
Data Engineer: Build Real-Time Pipelines & Trustworthy Data
Data Engineer: Build Real-Time Pipelines & Trustworthy Data

Rain • San Juan (PR)

Hybrid
USD 120,000 - 180,000
Unlimited vacation with 10 days min.
Flexible working (home/office) with a设
401(k) with company match
+2
Data Platform Engineer – Batch & Streaming, Equity
Data Platform Engineer – Batch & Streaming, Equity

raincards.xyz • San Juan (PR), New York (NY)

Hybrid
USD 150,000 - 210,000
Unlimited vacation
Flexible work
Home workspace stipend
+5
Data Engineer - Real-Time Pipelines & Scalable Data
Data Engineer - Real-Time Pipelines & Scalable Data

Rain Xyz • United States

Remote
USD 120,000 - 160,000
Data Platform Engineer — Scale Data & Governance (Remote)
Data Platform Engineer — Scale Data & Governance (Remote)

Solana Teams • San Juan (PR)

Hybrid
USD 130,000 - 190,000
Flexible time off
Flexible working
Home workspace stipend
+4