Lead Data Engineer

Prove

New York (NY)

Híbrido

USD 175.000 - 200.000

Jornada completa

Hace 4 días
Sé de los primeros/as/es en solicitar esta vacante

Una candidatura completa en un minuto

Currículum y carta de presentación personalizados, listos para enviar.

Supera los filtros ATS

Ventajas ofrecidas por este puesto de trabajo

401(k) Retirement Plan & Match
Unlimited vacation
Medical benefits for you and family
Equity plan
GrubHub stipend for lunch (US offices)

Descripción de la vacante

Prove, a data-driven identity platform, seeks a Lead Data Engineer in hybrid NYC to build pipelines powering real-time and batch inference for 1,000+ global clients. You will translate multi-domain logic into DAGs, establish data governance, and collaborate with data science, informatics and product teams to deliver high-integrity data assets that drive revenue and prevent fraud.

This role emphasizes experimentation, modern tooling, and scaling data infrastructure in a fast-paced environment

Formación

  • 7+ years of professional experience in data engineering or data-driven software products.
  • Deep understanding of data systems, distributed compute engines, data modeling, and modern pipeline architecture.
  • Experience translating cross-disciplinary logic into data systems and collaborating across teams.

Responsabilidades

  • Architect, build, and maintain resilient data pipelines powering real-time and batch inference.
  • Translate complex domain logic into DAGs and execution workflows.
  • Implement robust data governance, metadata management, and semantic ontologies.
  • Partner with data science, informatics, and product engineering teams to deliver high-integrity data extracts.
  • Evaluate and adopt cutting-edge data engineering tools and storage paradigms.
  • Optimize distributed data processing pipelines for high availability and cost governance.
  • Lead code reviews, architecture discussions, and CI/CD practices.
  • Promote Prove's values of humility, passion, inclusion, and leadership.

Conocimientos

Data engineering
Airflow/Dagster/Prefect
Distributed computing
Cross-functional collaboration

Educación

Advanced degree (MS/PhD) in CS/Math/Stats

Herramientas

Airflow
Dagster
Prefect
Linux/Unix

Descripción del empleo

About Prove

As the world moves to a mobile-first economy, businesses need to modernize how they acquire, engage with and enable consumers. Prove’s phone-centric identity tokenization and passive cryptographic authentication solutions reduce friction, enhance security and privacy across all digital channels, and accelerate revenues while reducing operating expenses and fraud losses. Over 1,000 enterprise customers use Prove’s platform to process 20 billion customer requests annually across industries, including banking, lending, healthcare, gaming, crypto, e-commerce, marketplaces, and payments. For the latest updates from Prove, follow us on LinkedIn.

Prove is driving the future of digital identity. We are looking for Provers who know how to make an impact. We’re talking self-starting professionals who thrive in a fast-paced environment, process information quickly, and make intelligent decisions. The work is challenging and requires not only smart but natural curiosity and tenacity. Teamwork is also important to us – we work together and play together.

Prove has big plans, and we’re excited about the future. If this sounds like the place for you – come join our team!

Title: Lead Data Engineer

Department: Data Science

Reports To: Director of Informatics

FLSA Status: Exempt

Location: Hybrid - New York, NY

Job Summary

As a Lead Data Engineer on Prove’s Data Science team, you will build the technical backbone that translates complex identity data into verified digital trust. Prove is fundamentally a data company: our identity solutions and analytical products are built on extracts spanning all tiers of data sophistication. In this role, every pipeline and architecture you design connects directly to revenue-generating products that secure transactions and prevent fraud for more than 1,000 global enterprise customers.

You will spearhead the development and maintenance of high-throughput data pipelines that power our core inference systems, taking raw intelligence and refining it into reliable scientific statements. Acting as a bridge across disciplines, you will translate multi-domain logic into resilient, highly performant directed acyclic graphs (DAGs), while proactively establishing data governance and ontology standards. This is an environment built for experimentation, offering you the autonomy to deploy modern paradigms and tools to solve intricate problems in identity resolution.

Key Responsibilities:

  • Architect, build, and maintain resilient data pipelines that power real-time and batch inference, moving data from raw intelligence to verifiable scientific statements.
  • Translate complex, multidisciplinary domain logic into efficient, maintainable, and modular directed acyclic graphs (DAGs) and execution workflows.
  • Proactively implement and advocate for robust data governance frameworks, metadata management, and semantic data ontologies.
  • Partner closely with data science, informatics, and product engineering teams to serve high-integrity data extracts that directly power revenue-generating products.
  • Continuously evaluate, benchmark, and adopt cutting-edge data engineering tools, frameworks, and storage paradigms.
  • Optimize distributed data processing pipelines for high availability, computational efficiency, and cost governance.
  • Champion engineering excellence across the team through code reviews, architectural discussions, automated testing, and CI/CD practices.
  • Promote, maintain and enhance our cultural values of humility, passion, inclusion, and leadership.

Qualifications and Experience:

  • Strong passion for learning about our products and markets through in-house and external training.
  • 7+ years of professional experience in data engineering or developing complex, data-driven software products.
  • Deep, first-principles understanding of data systems, distributed compute engines, data modeling, and modern pipeline architecture.
  • Demonstrated track record of collaborating across technical and scientific functions, with the ability to translate cross-disciplinary logic into concrete data systems.
  • High intellectual curiosity and a proactive mindset toward experimentation and technological innovation.
  • Hands-on experience with modern data orchestration (e.g., Airflow, Dagster, Prefect) and large-scale distributed frameworks.

Preferred Qualifications:

  • Advanced degree (Master’s or Ph.D.) in Computer Science, Mathematics, Statistics, Physics, or a related quantitative field.
  • Experience architecting creative solutions for identity resolution, graph data structures, or fraud prevention systems.
  • Fluent and terminal-native in Linux/Unix environments, command-line utilities, and shell scripting.
  • Experience in high-growth/pre-IPO Technology companies.

The anticipated salary pay range for Metro 3 areas for this role is $175,000 - $200,000 plus company bonus.

Prove follows a market driven compensation philosophy based on geographic location and respective market rates. Job offers will be aligned to location. Please speak with your recruiter if you have questions. Prove defines:

  • Metro 2 - NYC metro area, Seattle metro area, Los Angeles metro area, and the Miami metro area.
  • Metro 3 - all other cities across the domestic United States, with the exception of the San Francisco Bay Area.

Benefits & Perks for FTE Provers:

  • Competitive salaries & Bonus Plan (for eligible roles) and Equity Plan
  • Modern Health for financial, mental, and physical wellness
  • 401(k) Retirement Plan & Match (US Offices) and Local Country Pension (International Offices)
  • Unlimited Vacation and Flexible hours
  • Comprehensive medical benefits for you and your family
  • Emotional & Physical Wellness – Access to wellness services (EAP & Prove Well-Being Reimbursement)
  • Bottomless snacks & beverages for certain office locations
  • Daily GrubHub stipend for lunch if coming into the office (US Offices)
  • A great place to work and connect with other talented Provers like yourself!

Don’t meet every single requirement? Studies have shown that women and people of color are less likely to apply to jobs unless they meet every single qualification. At Prove we are dedicated to building a diverse, inclusive and authentic workplace, so if you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we encourage you to apply anyways. You may be just the right candidate for this or other roles.

Equal Opportunity Employment:

Prove is an equal opportunity employer committed to providing equal employment opportunity for all people regardless of race, color, religion, gender or sexual orientation, age, marital status, national origin, citizenship status, disability, veteran status or other personal characteristics

Privacy & Data Protection:

When you are applying for a job at Prove, we collect and use your personal information in the job application process. To understand more about how Prove uses your personal information, please see our Recruitment Privacy Policy on our website.

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Lead Data Engineer
Lead Data Engineer

Linuxconfig • New York (NY)

Híbrido
USD 175.000 - 200.000
Competitive salary
Bonus plan
Equity plan
+8
Data Scientist
Data Scientist

Prove • EE. UU.

A distancia
USD 140.000 - 190.000
Competitive salaries & bonus
Equity plan
Comprehensive medical benefits
+2
Senior Software Engineer
Senior Software Engineer

Prove • EE. UU.

A distancia
USD 170.000 - 210.000
Competitive salaries & Bonus Plan
Equity Plan
Modern Health
+6
Senior Software Engineer, Agentic
Senior Software Engineer, Agentic

Prove • EE. UU.

A distancia
USD 150.000 - 210.000
Competitive salary
Equity plan
401(k) retirement plan
+3
Senior Director, Global Implementation Services
Senior Director, Global Implementation Services

Prove • EE. UU.

A distancia
USD 221.000 - 247.000
Competitive salaries & Bonus Plan
Equity Plan
Modern Health for wellness
Site Reliability Engineer, Sr. Site Reliability Engineer
Site Reliability Engineer, Sr. Site Reliability Engineer

Prove • Oregon

Híbrido
USD 150.000 - 185.000
Competitive salary and equity
Comprehensive health benefits
Unlimited vacation
+2
Senior Director, Global Implementation Services
Senior Director, Global Implementation Services

Prove • New York (NY)

A distancia
USD 221.000 - 247.000
Competitive salaries & Bonus Plan
Modern Health for wellbeing
401(k) Retirement Plan & Match
+2
Senior Software Engineer - Knowledge Graph
Senior Software Engineer - Knowledge Graph

Prove • EE. UU.

A distancia
USD 170.000 - 210.000
Salary bonus
Health benefits
401(k) match
+5
Senior Director, Global Support
Senior Director, Global Support

Kenyan Edu • EE. UU.

Híbrido
USD 180.000 - 240.000
Competitive salaries & Bonus Plan
Equity Plan
Modern Health
+4
People Business Partner (GTM)
People Business Partner (GTM)

Prove • New York (NY)

Presencial
USD 90.000 - 140.000
Competitive salaries & bonus plan
Equity plan
Health benefits
+6