Data Platform Engineer – Batch & Streaming, Equity

raincards.xyz

San Juan, New York (PR, NY)

Hybrid

USD 150,000 - 210,000

Full time

7 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Unlimited vacation
Flexible work
Home workspace stipend
Health insurance
401(k) with company match
Equity
DoorDash meal credits
Team summits

Job summary

Rain is seeking a Data Platform Engineer to own the data and ML platform, building and running scalable batch and streaming pipelines. You will manage ingestion, processing, governance, and analytics tooling, serving engineers, analysts, and scientists who rely on reliable data to drive decisions.

You will automate access, deployments, and governance to keep the platform compliant, cost-efficient, and secure while enabling rapid experimentation across teams.

Qualifications

  • At least 4 years building and running data platforms in production on a cloud provider such as GCP, AWS, or Azure.
  • Experience designing data platforms at scale with multi-team access, reliability, and cost.
  • Experience operating cloud data warehouses and real-time stores (BigQuery, ClickHouse).
  • Experience operating streaming infra (Pub/Sub, Kafka, Dataflow, Flink) incl. retention, schema evolution, replay, lag monitoring.
  • Experience operating batch infrastructure (Dagster or Airflow), CI/CD, and environments.
  • Infrastructure as code with Terraform.
  • Experience with access control and data governance (IAM, security, PII handling).
  • Strong Python and SQL.
  • Proficiency using AI tools to learn new skills and accelerate work, while validating outputs.

Responsibilities

  • Design and build data platforms at scale for batch and streaming workloads, balancing latency, cost, and reliability.
  • Own infrastructure for BigQuery, streaming, Dagster/Airflow, and Lightdash as code, including CI/CD and deployments.
  • Manage access governance: IAM, PII handling, and audit logs across tables and streams.
  • Provide ML platform capabilities: feature pipelines, training data, and serving real-time features.
  • Develop platform tooling: templates, schema registry, data contracts, catalog, and lineage.
  • Monitor reliability, latency, and cost; optimize where needed.
  • Guide backend events and CDC integration into the warehouse; advise on event design.
  • Respond to platform incidents and automate repetitive tasks.

Skills

Python
SQL
AI tools usage
Data platform design
Cloud data warehousing

Tools

BigQuery
ClickHouse
Pub/Sub
Kafka
Dataflow
Flink
Dagster
Airflow
Terraform

Job description

Rain is seeking a Data Platform Engineer to own the data and ML platform, building and running scalable batch and streaming pipelines. You will manage ingestion, processing, governance, and analytics tooling, serving engineers, analysts, and scientists who rely on reliable data to drive decisions.

You will automate access, deployments, and governance to keep the platform compliant, cost-efficient, and secure while enabling rapid experimentation across teams.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Platform Engineer — Scale Big Data, AI-Driven, Equity
Data Platform Engineer — Scale Big Data, AI-Driven, Equity

Hivemind • New York (NY)

Hybrid
USD 120,000 - 190,000
Unlimited vacation
Flexible work setup
Home workspace stipend
+7
Data Platform Engineer: Cloud, Streaming & ML Pipelines
Data Platform Engineer: Cloud, Streaming & ML Pipelines

Rain • San Juan (PR)

Hybrid
USD 140,000 - 180,000
Unlimited vacation
Flexible working (work from home or in
Home office stipend
+6
Data Platform Engineer — Build Scalable, Governed Data & ML
Data Platform Engineer — Build Scalable, Governed Data & ML

Rain • United States

Hybrid
USD 180,000 - 240,000
Flexible time off
Flexible working
Home workspace stipend
+6
Data Platform Engineer — Scale & Govern Data Pipelines
Data Platform Engineer — Scale & Govern Data Pipelines

Rain • New York (NY)

Hybrid
USD 150,000 - 190,000
Unlimited vacation
Flexible work from home
Health/dental/vision 95% coverage
+2
Data Platform Engineer — Scale Data & Governance (Remote)
Data Platform Engineer — Scale Data & Governance (Remote)

Solana Teams • San Juan (PR)

Hybrid
USD 130,000 - 190,000
Flexible time off
Flexible working
Home workspace stipend
+4
Data Engineer - Real-Time Pipelines & Quality at Scale
Data Engineer - Real-Time Pipelines & Quality at Scale

raincards.xyz • San Juan (PR), New York (NY)

Remote
USD 120,000 - 160,000
Unlimited vacation with 10 days min
Flexible work location (home/office)
Home office stipend
+4
Data Engineer: Real-Time & Batch Pipelines
Data Engineer: Real-Time & Batch Pipelines

Solana Teams • San Juan (PR)

Hybrid
USD 120,000 - 190,000
Unlimited vacation with minimum 10‑day
Home office stipend
Health/dental/vision coverage (US)
+3
Data Engineer — Batch & Streaming Pipelines
Data Engineer — Batch & Streaming Pipelines

Hivemind • New York (NY)

Remote
USD 120,000 - 170,000
Health, dental, vision insurance
401(k) with 4% company match
Equity option plan
+3
Data Engineer (Batch & Streaming) - Hybrid + Equity
Data Engineer (Batch & Streaming) - Hybrid + Equity

Hivemind • United States

Hybrid
USD 150,000 - 190,000
Unlimited vacation
Flexible work
Health/dental/vision 95% covered
+4
Data Engineer: Build Real-Time Pipelines & Trustworthy Data
Data Engineer: Build Real-Time Pipelines & Trustworthy Data

Rain • San Juan (PR)

Hybrid
USD 120,000 - 180,000
Unlimited vacation with 10 days min.
Flexible working (home/office) with a设
401(k) with company match
+2