Lead Data Engineer

Linuxconfig

New York (NY)

Híbrido

USD 175.000 - 200.000

Jornada completa

hace 38 horas
Sé de los primeros/as/es en solicitar esta vacante

Consigue una respuesta de este empleador

Tu currículum y tu carta de presentación, adaptados exactamente a lo que buscan contratar.

Supera los filtros ATS

Ventajas ofrecidas por este puesto de trabajo

Competitive salary
Bonus plan
Equity plan
Health insurance
401(k) retirement plan & match
Unlimited vacation
Medical benefits
Wellness programs
Snacks & beverages
Lunch stipend
Team culture

Descripción de la vacante

Prove is hiring a Lead Data Engineer to build the backbone of identity data for revenue-generating products. You will craft high-throughput pipelines translating raw data into verifiable insights, and establish governance and ontology standards across disciplines.

You will lead cross-functional teams to deliver robust, scalable data architectures while advancing modern tooling and practices in a fast-paced, hybrid New York setting.

Formación

  • 7+ years of professional experience in data engineering or data-driven software.
  • Deep understanding of data systems, distributed compute, modeling and pipelines.
  • Experience translating cross-disciplinary logic into data systems.
  • Hands-on with modern orchestration tools and large-scale frameworks.

Responsabilidades

  • Architect and maintain high-throughput data pipelines for real-time and batch inference.
  • Translate complex domain logic into DAGs and execution workflows.
  • Implement robust data governance, metadata management and ontologies.
  • Collaborate with data science, informatics and product engineering teams.
  • Evaluate and adopt cutting-edge data engineering tools and storage paradigms.
  • Optimize pipelines for availability, efficiency and cost governance.
  • Promote engineering excellence through reviews, testing and CI/CD.

Conocimientos

Data engineering
Data systems
Distributed compute
Data modeling
Pipeline architecture
Airflow
Dagster
Prefect
Cross-disciplinary collaboration
Linux/Unix

Educación

Advanced degree in CS/Math/Stats/Physics

Herramientas

Airflow
Dagster
Prefect

Descripción del empleo

As the world moves to a mobile-first economy, businesses need to modernize how they acquire, engage with and enable consumers. Prove’s phone-centric identity tokenization and passive cryptographic authentication solutions reduce friction, enhance security and privacy across all digital channels, and accelerate revenues while reducing operating expenses and fraud losses. Over 1,000 enterprise customers use Prove’s platform to process 20 billion customer requests annually across industries, including banking, lending, healthcare, gaming, crypto, e-commerce, marketplaces, and payments. For the latest updates from Prove, follow us on LinkedIn.

Prove is driving the future of digital identity. We are looking for Provers who know how to make an impact. We’re talking self-starting professionals who thrive in a fast-paced environment, process information quickly, and make intelligent decisions. The work is challenging and requires not only smart but natural curiosity and tenacity. Teamwork is also important to us – we work together and play together.

Prove has big plans, and we’re excited about the future. If this sounds like the place for you – come join our team!

Title: Lead Data Engineer

Department: Data Science

Reports To: Director of Informatics

FLSA Status: Exempt

Location: Hybrid - New York, NY

Job Summary

As a Lead Data Engineer on Prove’s Data Science team, you will build the technical backbone that translates complex identity data into verified digital trust. Prove is fundamentally a data company: our identity solutions and analytical products are built on extracts spanning all tiers of data sophistication. In this role, every pipeline and architecture you design connects directly to revenue-generating products that secure transactions and prevent fraud for more than 1,000 global enterprise customers.

You will spearhead the development and maintenance of high-throughput data pipelines that power our core inference systems, taking raw intelligence and refining it into reliable scientific statements. Acting as a bridge across disciplines, you will translate multi-domain logic into resilient, highly performant directed acyclic graphs (DAGs), while proactively establishing data governance and ontology standards. This is an environment built for experimentation, offering you the autonomy to deploy modern paradigms and tools to solve intricate problems in identity resolution.

Key Responsibilities:

  • Architect, build, and maintain resilient data pipelines that power real-time and batch inference, moving data from raw intelligence to verifiable scientific statements.
  • Translate complex, multidisciplinary domain logic into efficient, maintainable, and modular directed acyclic graphs (DAGs) and execution workflows.
  • Proactively implement and advocate for robust data governance frameworks, metadata management, and semantic data ontologies.
  • Partner closely with data science, informatics, and product engineering teams to serve high-integrity data extracts that directly power revenue-generating products.
  • Continuously evaluate, benchmark, and adopt cutting-edge data engineering tools, frameworks, and storage paradigms.
  • Optimize distributed data processing pipelines for high availability, computational efficiency, and cost governance.
  • Champion engineering excellence across the team through code reviews, architectural discussions, automated testing, and CI/CD practices.
  • Promote, maintain and enhance our cultural values of humility, passion, inclusion, and leadership.
Qualifications and Experience:
  • Strong passion for learning about our products and markets through in-house and external training.
  • 7+ years of professional experience in data engineering or developing complex, data-driven software products.
  • Deep, first-principles understanding of data systems, distributed compute engines, data modeling, and modern pipeline architecture.
  • Demonstrated track record of collaborating across technical and scientific functions, with the ability to translate cross-disciplinary logic into concrete data systems.
  • High intellectual curiosity and a proactive mindset toward experimentation and technological innovation.
  • Hands-on experience with modern data orchestration (e.g., Airflow, Dagster, Prefect) and large-scale distributed frameworks.

Preferred Qualifications:

  • Advanced degree (Master’s or Ph.D.) in Computer Science, Mathematics, Statistics, Physics, or a related quantitative field.
  • Experience architecting creative solutions for identity resolution, graph data structures, or fraud prevention systems.
  • Fluent and terminal-native in Linux/Unix environments, command-line utilities, and shell scripting.
  • Experience in high-growth/pre-IPO Technology companies.

The anticipated salary pay range for Metro 3 areas for this role is $175,000 - $200,000 plus company bonus.

Prove follows a market driven compensation philosophy based on geographic location and respective market rates. Job offers will be aligned to location. Please speak with your recruiter if you have questions. Prove defines:

  • Metro 2 - NYC metro area, Seattle metro area, Los Angeles metro area, and the Miami metro area.
  • Metro 3 - all other cities across the domestic United States, with the exception of the San Francisco Bay Area.
Benefits & Perks for FTE Provers:
  • Competitive salaries & Bonus Plan (for eligible roles) and Equity Plan
  • Modern Health for financial, mental, and physical wellness
  • 401(k) Retirement Plan & Match (US Offices) and Local Country Pension (International Offices)
  • Unlimited Vacation and Flexible hours
  • Comprehensive medical benefits for you and your family
  • Emotional & Physical Wellness – Access to wellness services (EAP & Prove Well-Being Reimbursement)
  • Bottomless snacks & beverages for certain office locations
  • Daily GrubHub stipend for lunch if coming into the office (US Offices)
  • A great place to work and connect with other talented Provers like yourself!

Don’t meet every single requirement? Studies have shown that women and people of color are less likely to apply to jobs unless they meet every single qualification. At Prove we are dedicated to building a diverse, inclusive and authentic workplace, so if you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we encourage you to apply anyways. You may be just the right candidate for this or other roles.

Equal Opportunity Employment:Prove is an equal opportunity employer committed to providing equal employment opportunity for all people regardless of race, color, religion, gender or sexual orientation, age, marital status, national origin, citizenship status, disability, veteran status or other personal characteristics

Privacy & Data Protection: When you are applying for a job at Prove, we collect and use your personal information in the job application process. To understand more about how Prove uses your personal information, please see our Recruitment Privacy Policy on our website.

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Lead Data Engineer
Lead Data Engineer

Prove • New York (NY)

Híbrido
USD 175.000 - 200.000
401(k) Retirement Plan & Match
Unlimited vacation
Medical benefits for you and family
+2
Data Scientist
Data Scientist

Prove • EE. UU.

A distancia
USD 140.000 - 190.000
Competitive salaries & bonus
Equity plan
Comprehensive medical benefits
+2
Senior Director, Global Implementation Services
Senior Director, Global Implementation Services

Prove • EE. UU.

A distancia
USD 221.000 - 247.000
Competitive salaries & Bonus Plan
Equity Plan
Modern Health for wellness
Senior Director, Global Implementation Services
Senior Director, Global Implementation Services

Prove • New York (NY)

A distancia
USD 221.000 - 247.000
Competitive salaries & Bonus Plan
Modern Health for wellbeing
401(k) Retirement Plan & Match
+2
Senior Software Engineer, Agentic
Senior Software Engineer, Agentic

Prove • EE. UU.

A distancia
USD 150.000 - 210.000
Competitive salary
Equity plan
401(k) retirement plan
+3
Senior Software Engineer - Knowledge Graph
Senior Software Engineer - Knowledge Graph

Prove • EE. UU.

A distancia
USD 170.000 - 210.000
Salary bonus
Health benefits
401(k) match
+5
Senior Software Engineer
Senior Software Engineer

Prove • EE. UU.

A distancia
USD 170.000 - 210.000
Competitive salaries & Bonus Plan
Equity Plan
Modern Health
+6
Site Reliability Engineer, Sr. Site Reliability Engineer
Site Reliability Engineer, Sr. Site Reliability Engineer

Prove • Oregon

Híbrido
USD 150.000 - 185.000
Competitive salary and equity
Comprehensive health benefits
Unlimited vacation
+2
People Business Partner (GTM)
People Business Partner (GTM)

Prove • New York (NY)

Presencial
USD 90.000 - 140.000
Competitive salaries & bonus plan
Equity plan
Health benefits
+6
Senior Director, Global Support
Senior Director, Global Support

Kenyan Edu • EE. UU.

Híbrido
USD 180.000 - 240.000
Competitive salaries & Bonus Plan
Equity Plan
Modern Health
+4