Lead Data Engineer

ResumeXrays LLC

New York (NY)

Hybrid

USD 175,000 - 200,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive salary
Bonus program
401(k)
Healthcare benefits
Flexible hours
Unlimited vacation

Job summary

Prove is seeking a Lead Data Engineer on the Data Science team to build the backbone that translates complex identity data into verified digital trust. This role focuses on turning raw intelligence into reliable, revenue-driving insights and scalable inference systems.

You will design high-throughput pipelines, shape DAG-based workflows, and establish governance standards, enabling cross-functional teams to deploy modern data solutions at scale.

Qualifications

  • 7+ years of professional experience in data engineering or developing complex, data-driven software products.
  • Deep, first-principles understanding of data systems, distributed compute engines, data modeling, and modern pipeline architecture.
  • Demonstrated ability to translate cross-disciplinary logic into concrete data systems.

Responsibilities

  • Architect, build, and maintain resilient data pipelines for real-time and batch inference.
  • Translate complex domain logic into modular DAGs and execution workflows.
  • Implement robust data governance, metadata management, and semantic ontologies.
  • Partner with data science, informatics, and product engineering to power revenue-generating products.
  • Evaluate and adopt cutting-edge data engineering tools and storage paradigms.
  • Optimize data pipelines for high availability and cost governance.
  • Promote engineering excellence via code reviews, testing, and CI/CD.

Skills

Data engineering
Airflow
Dagster
Prefect
Distributed compute
Data governance
Collaboration
Linux

Education

Advanced degree (MS/PhD) in CS/Math/Stats/Physics

Tools

Airflow
Dagster
Prefect
Linux
Shell scripting

Job description

About Prove

As the world moves to a mobile-first economy, businesses need to modernize how they acquire, engage with and enable consumers. Prove’s phone-centric identity tokenization and passive cryptographic authentication solutions reduce friction, enhance security and privacy across all digital channels, and accelerate revenues while reducing operating expenses and fraud losses. Over 1,000 enterprise customers use Prove’s platform to process 20 billion customer requests annually across industries, including banking, lending, healthcare, gaming, crypto, e-commerce, marketplaces, and payments. For the latest updates from Prove, follow us on LinkedIn.

Prove is driving the future of digital identity. We are looking for Provers who know how to make an impact. We’re talking self-starting professionals who thrive in a fast-paced environment, process information quickly, and make intelligent decisions. The work is challenging and requires not only smart but natural curiosity and tenacity. Teamwork is also important to us – we work together and play together.

Prove has big plans, and we’re excited about the future. If this sounds like the place for you – come join our team!

Title: Lead Data Engineer

Department: Data Science

Reports To: Director of Informatics

FLSA Status: Exempt

Location: Hybrid - New York, NY

Job Summary

As a Lead Data Engineer on Prove’s Data Science team, you will build the technical backbone that translates complex identity data into verified digital trust. Prove is fundamentally a data company: our identity solutions and analytical products are built on extracts spanning all tiers of data sophistication. In this role, every pipeline and architecture you design connects directly to revenue-generating products that secure transactions and prevent fraud for more than 1,000 global enterprise customers.

You will spearhead the development and maintenance of high-throughput data pipelines that power our core inference systems, taking raw intelligence and refining it into reliable scientific statements. Acting as a bridge across disciplines, you will translate multi-domain logic into resilient, highly performant directed acyclic graphs (DAGs), while proactively establishing data governance and ontology standards. This is an environment built for experimentation, offering you the autonomy to deploy modern paradigms and tools to solve intricate problems in identity resolution.

Key Responsibilities:
  • Architect, build, and maintain resilient data pipelines that power real-time and batch inference, moving data from raw intelligence to verifiable scientific statements.
  • Translate complex, multidisciplinary domain logic into efficient, maintainable, and modular directed acyclic graphs (DAGs) and execution workflows.
  • Proactively implement and advocate for robust data governance frameworks, metadata management, and semantic data ontologies.
  • Partner closely with data science, informatics, and product engineering teams to serve high-integrity data extracts that directly power revenue-generating products.
  • Continuously evaluate, benchmark, and adopt cutting-edge data engineering tools, frameworks, and storage paradigms.
  • Optimize distributed data processing pipelines for high availability, computational efficiency, and cost governance.
  • Champion engineering excellence across the team through code reviews, architectural discussions, automated testing, and CI/CD practices.
  • Promote, maintain and enhance our cultural values of humility, passion, inclusion, and leadership.
Qualifications and Experience:
  • Strong passion for learning about our products and markets through in-house and external training.
  • 7+ years of professional experience in data engineering or developing complex, data-driven software products.
  • Deep, first-principles understanding of data systems, distributed compute engines, data modeling, and modern pipeline architecture.
  • Demonstrated track record of collaborating across technical and scientific functions, with the ability to translate cross-disciplinary logic into concrete data systems.
  • High intellectual curiosity and a proactive mindset toward experimentation and technological innovation.
  • Hands-on experience with modern data orchestration (e.g., Airflow, Dagster, Prefect) and large-scale distributed frameworks.
Preferred Qualifications:
  • Advanced degree (Master’s or Ph.D.) in Computer Science, Mathematics, Statistics, Physics, or a related quantitative field.
  • Experience architecting creative solutions for identity resolution, graph data structures, or fraud prevention systems.
  • Fluent and terminal-native in Linux/Unix environments, command-line utilities, and shell scripting.
  • Experience in high-growth/pre-IPO Technology companies.

The anticipated salary pay range for Metro 3 areas for this role is $175,000 - $200,000 plus company bonus.

Prove follows a market driven compensation philosophy based on geographic location and respective market rates. Job offers will be aligned to location. Please speak with your recruiter if you have questions.

  • Metro 2 - NYC metro area, Seattle metro area, Los Angeles metro area, and the Miami metro area.
  • Metro 3 - all other cities across the domestic United States, with the exception of the San Francisco Bay Area.
Benefits & Perks for FTE Provers:
  • Competitive salaries & Bonus Plan (for eligible roles) and Equity Plan
  • Modern Health for financial, mental, and physical wellness
  • 401(k) Retirement Plan & Match (US Offices) and Local Country Pension (International Offices)
  • Unlimited Vacation and Flexible hours
  • Comprehensive medical benefits for you and your family
  • Emotional & Physical Wellness – Access to wellness services (EAP & Prove Well-Being Reimbursement)
  • Bottomless snacks & beverages for certain office locations
  • Daily GrubHub stipend for lunch if coming into the office (US Offices)
  • A great place to work and connect with other talented Provers like yourself!

Equal Opportunity Employment: Prove is an equal opportunity employer committed to providing equal employment opportunity for all people regardless of race, color, religion, gender or sexual orientation, age, marital status, national origin, citizenship status, disability, veteran status or other personal characteristics

Privacy & Data Protection: When you are applying for a job at Prove, we collect and use your personal information in the job application process. To understand more about how Prove uses your personal information, please see our Recruitment Privacy Policy on our website.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Engineer
Lead Data Engineer

Prove • New York (NY)

Hybrid
USD 175,000 - 200,000
401(k) Retirement Plan & Match
Unlimited vacation
Medical benefits for you and family
+2
Lead Data Engineer
Lead Data Engineer

Linuxconfig • New York (NY)

Hybrid
USD 175,000 - 200,000
Competitive salary
Bonus plan
Equity plan
+8
Data Scientist
Data Scientist

Prove • United States

Remote
USD 140,000 - 190,000
Competitive salaries & bonus
Equity plan
Comprehensive medical benefits
+2
Senior Software Engineer
Senior Software Engineer

Prove • United States

Remote
USD 170,000 - 210,000
Competitive salaries & Bonus Plan
Equity Plan
Modern Health
+6
Senior Software Engineer, Agentic
Senior Software Engineer, Agentic

Prove • United States

Remote
USD 150,000 - 210,000
Competitive salary
Equity plan
401(k) retirement plan
+3
Site Reliability Engineer, Sr. Site Reliability Engineer
Site Reliability Engineer, Sr. Site Reliability Engineer

Prove • Oregon

Hybrid
USD 150,000 - 185,000
Competitive salary and equity
Comprehensive health benefits
Unlimited vacation
+2
Senior Software Engineer - Knowledge Graph
Senior Software Engineer - Knowledge Graph

Prove • United States

Remote
USD 170,000 - 210,000
Salary bonus
Health benefits
401(k) match
+5
Senior Director, Global Implementation Services
Senior Director, Global Implementation Services

Prove • United States

Remote
USD 221,000 - 247,000
Competitive salaries & Bonus Plan
Equity Plan
Modern Health for wellness
Senior Director, Global Implementation Services
Senior Director, Global Implementation Services

Prove • New York (NY)

Remote
USD 221,000 - 247,000
Competitive salaries & Bonus Plan
Modern Health for wellbeing
401(k) Retirement Plan & Match
+2
Senior Director, Global Support
Senior Director, Global Support

Kenyan Edu • United States

Hybrid
USD 180,000 - 240,000
Competitive salaries & Bonus Plan
Equity Plan
Modern Health
+4