Lead Data Engineer: Real-Time Pipelines & Equity

ResumeXrays LLC

New York (NY)

Hybrid

USD 175,000 - 200,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive salary
Bonus program
401(k)
Healthcare benefits
Flexible hours
Unlimited vacation

Job summary

Prove is seeking a Lead Data Engineer on the Data Science team to build the backbone that translates complex identity data into verified digital trust. This role focuses on turning raw intelligence into reliable, revenue-driving insights and scalable inference systems.

You will design high-throughput pipelines, shape DAG-based workflows, and establish governance standards, enabling cross-functional teams to deploy modern data solutions at scale.

Qualifications

  • 7+ years of professional experience in data engineering or developing complex, data-driven software products.
  • Deep, first-principles understanding of data systems, distributed compute engines, data modeling, and modern pipeline architecture.
  • Demonstrated ability to translate cross-disciplinary logic into concrete data systems.

Responsibilities

  • Architect, build, and maintain resilient data pipelines for real-time and batch inference.
  • Translate complex domain logic into modular DAGs and execution workflows.
  • Implement robust data governance, metadata management, and semantic ontologies.
  • Partner with data science, informatics, and product engineering to power revenue-generating products.
  • Evaluate and adopt cutting-edge data engineering tools and storage paradigms.
  • Optimize data pipelines for high availability and cost governance.
  • Promote engineering excellence via code reviews, testing, and CI/CD.

Skills

Data engineering
Airflow
Dagster
Prefect
Distributed compute
Data governance
Collaboration
Linux

Education

Advanced degree (MS/PhD) in CS/Math/Stats/Physics

Tools

Airflow
Dagster
Prefect
Linux
Shell scripting

Job description

Prove is seeking a Lead Data Engineer on the Data Science team to build the backbone that translates complex identity data into verified digital trust. This role focuses on turning raw intelligence into reliable, revenue-driving insights and scalable inference systems.

You will design high-throughput pipelines, shape DAG-based workflows, and establish governance standards, enabling cross-functional teams to deploy modern data solutions at scale.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Engineer - Real-Time Identity Pipelines
Lead Data Engineer - Real-Time Identity Pipelines

Linuxconfig • New York (NY)

Hybrid
USD 175,000 - 200,000
Competitive salary
Bonus plan
Equity plan
+8
Lead Data Engineer - Real-Time Identity Platform (Hybrid)
Lead Data Engineer - Real-Time Identity Platform (Hybrid)

Prove • New York (NY)

Hybrid
USD 175,000 - 200,000
401(k) Retirement Plan & Match
Unlimited vacation
Medical benefits for you and family
+2
Lead Data Engineer: Scalable Pipelines & AI-Driven Insights
Lead Data Engineer: Scalable Pipelines & AI-Driven Insights

Code and Theory, LLC • Chicago (IL)

On-site
USD 120,000 - 160,000
Lead Data Engineer: AI/ML Pipelines & Infra
Lead Data Engineer: AI/ML Pipelines & Infra

BlackLine Systems • Pleasanton (CA)

On-site
USD 245,000 - 307,000
Lead Data Engineer: Architect & Deliver Scalable Pipelines
Lead Data Engineer: Architect & Deliver Scalable Pipelines

EPAM Systems Inc • United States

Remote
USD 140,000 - 190,000
Healthcare benefits
Employee training & certificates
Paid time off
Lead Data Engineer for AI & ML Pipelines
Lead Data Engineer for AI & ML Pipelines

BlackLine, Inc. • Los Angeles (CA)

On-site
USD 245,000 - 307,000
Lead AI/ML Data Engineer: Scalable Pipelines & Ops
Lead AI/ML Data Engineer: Scalable Pipelines & Ops

BlackLine Systems, Inc. • Seattle (WA)

Hybrid
USD 245,000 - 307,000
Lead Data Engineer: PySpark & AI Pipelines
Lead Data Engineer: PySpark & AI Pipelines

BlackLine, Inc. • New York (NY)

On-site
USD 193,000 - 242,000
Senior Data Engineer: Build Scalable Pipelines & Cloud
Senior Data Engineer: Build Scalable Pipelines & Cloud

ReturnPro LLP • Florida

On-site
USD 110,000 - 150,000
Lead Data Engineer — Scalable Pipelines & Data Quality
Lead Data Engineer — Scalable Pipelines & Data Quality

Attic Projects • Irving (TX)

On-site
USD 145,000 - 180,000
Health insurance
Dental insurance
Vision coverage
+9