Data Engineer: Real-Time, Scalable Pipelines

Tephra

España

Hybrid

EUR 60,000 - 100,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Flexible time off
Flexible working
Health benefits
401(k) match
Equity plan
Wellness stipend
Office meals
Team summits

Job summary

Rain builds payments and stablecoin infrastructure. We are seeking a Data Engineer with batch and streaming experience to bring data into our warehouse. You will create scalable, idempotent pipelines, handle late and duplicate data, and alert when issues arise.

In this role you will automate ingestion and quality checks so new sources come online quickly and stay trustworthy. You will work with Analytics Engineers, Data Scientists, and Risk on data needs and ML features.

Qualifications

  • 3+ years building production data solutions, end-to-end from source to warehouse.
  • Experience designing data solutions at scale.
  • Strong SQL and Python/Rust; familiarity with cloud data warehouses and their trade-offs.
  • Streaming experience with Pub/Sub, Kafka, Dataflow/Beam, or Flink.
  • Batch experience with dbt and orchestrators like Dagster or Airflow.
  • Experience with production data quality testing, monitoring, and reconciliation.
  • Ability to debug across source database, pipeline, warehouse and reports.
  • Ability to use AI tools to learn and work faster while verifying outputs.

Responsibilities

  • Build scalable batch and streaming pipelines with latency, cost, and correctness in mind.
  • Process events in near real time; handle deduplication and late/out-of-order data.
  • Own batch ingestion from databases, files, APIs, and onchain sources.
  • Develop incremental dbt models handling late data, duplicates, CDC deletions, and backfills.
  • Orchestrate pipelines in Dagster with sensors, schedules, and alerts.
  • Add freshness, volume, and reconciliation checks to all sources and diagnose root causes.
  • Collaborate with Analytics Engineers, Data Scientists, and Risk on data needs, including ML features.

Skills

SQL
Python
Rust

Tools

BigQuery
ClickHouse
Snowflake
Pub/Sub
Kafka
Dataflow/Beam
Flink
dbt
Dagster
Airflow

Job description

Rain builds payments and stablecoin infrastructure. We are seeking a Data Engineer with batch and streaming experience to bring data into our warehouse. You will create scalable, idempotent pipelines, handle late and duplicate data, and alert when issues arise.

In this role you will automate ingestion and quality checks so new sources come online quickly and stay trustworthy. You will work with Analytics Engineers, Data Scientists, and Risk on data needs and ML features.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Platform Engineer: Scale Batch & Streaming
Data Platform Engineer: Scale Batch & Streaming

Unchain Data • Spain

Hybrid
EUR 109,000 - 154,000
Unlimited vacation
Home workspace stipend
Health insurance (US) coverage details
+2
Data Platform Engineer — Scalable, Secure, & Equity
Data Platform Engineer — Scalable, Secure, & Equity

Rain • Spain

Hybrid
EUR 70,000 - 110,000
Unlimited vacation (min 10 days)
Flexible working
Home workspace stipend
+5
Data Engineer: Build Scalable Pipelines for Analytics
Data Engineer: Build Scalable Pipelines for Analytics

Approach People • Madrid

Hybrid
EUR 48,000 - 80,000
Data Engineer
Data Engineer

Tephra • Spain

Hybrid
EUR 60,000 - 100,000
Flexible time off
Flexible working
Health benefits
+5
Hybrid Data Engineer for Real-Time AI Pipelines
Hybrid Data Engineer for Real-Time AI Pipelines

Quadient • Barcelona

Hybrid
EUR 65,000 - 90,000
Flexible Work: Hybrid model
Online learning platform
Inclusive community programs
+2
Senior Data Engineer: Real-Time Data Pipelines (Remote)
Senior Data Engineer: Real-Time Data Pipelines (Remote)

The Hotels Network • Barcelona

Remote
EUR 65,000 - 110,000
Flexible time off
Alan Flex benefit
Tax-free benefits
+4
Senior Data Engineer - Cloud-Native AI Pipelines
Senior Data Engineer - Cloud-Native AI Pipelines

Fadata • Madrid

On-site
EUR 55,000 - 75,000
Competitive remuneration
Multinational team culture
Half-day off on the second Friday of每月
Senior Data Engineer: Cloud Data Pipelines & Real-Time
Senior Data Engineer: Cloud Data Pipelines & Real-Time

Thunes • Barcelona

On-site
EUR 70,000 - 100,000
Data Engineer: Build Scalable Distributed Pipelines (Malta Relocation)
Data Engineer: Build Scalable Distributed Pipelines (Malta Relocation)

GCS Recruitment • Córdoba

Remote
EUR 80,000 - 120,000
Data Engineer — Agile Pipelines & APIs for Finance
Data Engineer — Agile Pipelines & APIs for Finance

Softlanding • Spain

Hybrid
EUR 45,000 - 60,000
Impactful data projects
Agile collaboration
Established data platform