Senior Data Engineering Lead — AI-Powered Pipelines

Neura Market; New York (NY); Hybrid; USD 129,000 - 215,000; Full time

Benefits offered by this job

Flexible work hours

Flexible vacation

401K match

Parental leave

Wellness budget

Learning reimbursement

Job summary

YipitData is seeking a Senior Data Engineering Manager to lead one of our data engineering teams. This hands-on player-coach role drives architecture, develops engineers, and contributes to AI-powered data feeds.

You'll own central data pipelines and production datasets across multiple business units, guiding data quality, observability, and reliability while mentoring a global team and collaborating with PMs and stakeholders.

Qualifications

• 8+ years of professional experience in data engineering, data architecture, big data development, ETL engineering, or related technical roles.
• 3+ years of managerial experience, including mentoring, team leadership, and supporting delivery.
• Experience managing, mentoring, or formally leading data engineers or technical teams in a hands-on player-coach capacity.
• Strong hands-on expertise with SQL, PySpark, Databricks, and Airflow or similar workflow orchestration tools and AI toolings.
• Experience building, maintaining, or scaling business-critical data systems, including pipelines, production datasets, data delivery systems, or customer-facing data products.
• Experience working with OLTP and OLAP use cases
• Deep technical judgment across data modeling, distributed data systems, pipeline architecture, orchestration, data quality, observability, and production reliability.
• Strong communication and cross-functional collaboration skills, especially with Product, Research, Operations, Client Success, Sales, and Engineering stakeholders.

Responsibilities

• Lead, coach, and develop a global team of data engineers while staying close to architecture, design, code reviews, debugging, and delivery.
• Partner with Technical Product Managers and Data leads to translate roadmap priorities, customer needs, and research requirements into scalable technical plans.
• Build and improve scalable data pipelines, data models, and QA systems for various data products.
• Collaborate with business stakeholders and PMs to support reliable delivery of data pipelines, incident resolution, methodologies, and operational improvements.
• Use AI coding tools to develop and enhance methodologies, accelerate engineering execution, improve documentation, strengthen QA, support technical exploration, and raise team productivity.
• Create clarity and momentum in ambiguous environments by breaking down complex data, research, and product challenges into actionable engineering plans.

Skills

SQL

PySpark

AI tooling

Data modeling

Education

Bachelor's degree in a technical field

Tools

Databricks

Airflow

Job description

YipitData is seeking a Senior Data Engineering Manager to lead one of our data engineering teams. This hands-on player-coach role drives architecture, develops engineers, and contributes to AI-powered data feeds.

You'll own central data pipelines and production datasets across multiple business units, guiding data quality, observability, and reliability while mentoring a global team and collaborating with PMs and stakeholders.