Senior Data Flow Engineer — Remote Pipelines

Revelio Labs, Inc.; New York (NY); On-site; USD 150,000 - 220,000; Full time

Benefits offered by this job

Equity program

Medical insurance

Dental insurance

Vision insurance

Retirement plan

Job summary

Revelio Labs, Inc. is seeking a Senior Software Engineer to design, build, operate core data flow systems and own end-to-end pipelines—from ingestion to publication and monitoring. Emphasis on correctness, observability, and scalable data handling.

Based in New York City but open to remote work, you will collaborate with Data Acquisition, Data Science, Economics, and product teams. You’ll help move large, noisy datasets into reliable, production-ready datasets and insights for customers and

Qualifications

• 4+ years of professional experience in a production software or data engineering role.
• Strong programming ability in Python, Go, and/or Rust.
• Strong SQL skills and ability to debug complex data quality issues.
• Experience building or operating large production data pipelines.
• Experience with incremental processing, idempotency, data versioning, and schema evolution.
• Familiarity with the full data system stack including orchestration, storage, and data warehouses.
• Experience with Flyte, Argo Workflows, Snowflake or ClickHouse, Terraform, AWS.

Responsibilities

• Own and operate production data flow pipelines end to end: ingestion, transformation, enrichment, validation, publication, and monitoring.
• Build and improve reusable flow patterns for high-volume datasets such as profiles, companies, job postings, and related enrichments.
• Debug production failures across multiple layers: source data, code, orchestration, storage, Kubernetes, data warehouses, models, and product expectations.
• Investigate data correctness issues, including unexpected metrics and client-facing discrepancies.
• Design and implement guardrails: validation checks, lifecycle checks, monitors, alerts, data contracts, runbooks, and safer release patterns.
• Improve pipeline reliability, performance, and cost efficiency by tuning resources and orchestration patterns.

Skills

Python

Go

Rust

SQL

Data pipelines

NLP models

Entity resolution

System design

Debug production data issues

Data versioning

Tools

Flyte

Argo Workflows

Snowflake

ClickHouse

Terraform

AWS

Job description

Revelio Labs, Inc. is seeking a Senior Software Engineer to design, build, operate core data flow systems and own end-to-end pipelines—from ingestion to publication and monitoring. Emphasis on correctness, observability, and scalable data handling.

Based in New York City but open to remote work, you will collaborate with Data Acquisition, Data Science, Economics, and product teams. You’ll help move large, noisy datasets into reliable, production-ready datasets and insights for customers and