Backend Engineer, High-Volume Data Pipelines (Onsite)

Dreams 2 Reality Recruitment; New York (NY); On-site; USD 220,000 - 300,000; Full time

Benefits offered by this job

Relocation assistance

OPT/H-1B sponsorship

Job summary

Dreams 2 Reality Recruitment in New York seeks a Backend Engineer to build data-processing pipelines that de-identify enterprise data and prepare AI-training datasets. You will own backend systems end-to-end in a fast-growing startup environment.

This role focuses on the processing logic, not traditional data engineering, with opportunities to influence architecture, reliability, and observability. You’ll work onsite in Dumbo, Brooklyn, five days per week.

Qualifications

• 3–10 years of software engineering experience with ownership of production backend systems.
• Experience shipping/operating production software with multi-stage data-processing pipelines.
• Undergraduate STEM degree from a top-30 US institution.
• Strong understanding of distributed and asynchronous backend systems.
• Full-time startup experience with ownership in ambiguous environments.
• Strong proficiency in a general-purpose backend language.
• Willing to work onsite five days per week in Dumbo, Brooklyn, NY.

Responsibilities

• Design, build, and scale multi-stage, high-volume data-processing pipelines that de-identify sensitive enterprise data.
• Own backend systems end-to-end, from architecture and implementation through debugging and production monitoring.
• Develop safeguards to detect silent failures, duplicates, and stale data before delivery.
• Build retries, checkpoints, partial failures, replay, backfills, and rollbacks across workflows.
• Develop internal tools and dashboards to monitor pipeline performance and data quality.
• Partner with ML, full-stack, platform, and security engineers to expand capabilities.
• Improve reliability, observability, and scalability of complex data-processing systems.

Skills

Backend ownership

Production systems

Distributed systems

Multi-stage pipelines

Startup experience

Onsite in NYC

Education

Undergraduate STEM degree (top-30 US)

Tools

Python

AWS

Airflow

AWS Batch

SQS

S3

DynamoDB

PostgreSQL

Job description

Dreams 2 Reality Recruitment in New York seeks a Backend Engineer to build data-processing pipelines that de-identify enterprise data and prepare AI-training datasets. You will own backend systems end-to-end in a fast-growing startup environment.

This role focuses on the processing logic, not traditional data engineering, with opportunities to influence architecture, reliability, and observability. You’ll work onsite in Dumbo, Brooklyn, five days per week.