Lead Data Engineer

Logicbroker, Inc.; New York (NY); Hybrid; USD 140,000 - 190,000; Full time

Job summary

Logicbroker in New York is hiring a Lead Data Engineer to drive delivery across our analytics and data platform initiatives. This hands-on technical lead translates engineering specs into executable work, coordinates contractors, and partners with an Engineering Manager on architectural direction.

You will execute a data warehouse unification plan, design multi-region pipelines, and ensure gold-layer outputs are reliable for downstream analytics engines.

Qualifications

• Strong hands-on experience with Databricks, PySpark and Spark SQL.
• Experience leading delivery for small engineering teams (formal management not required).
• Clear written and verbal communication in a distributed/remote environment.

Responsibilities

• Lead a small delivery team and guide contractor contributions.
• Unblock work and keep scope aligned for steady momentum.
• Refine analytics foundations and gold-layer data models.
• Design and implement Bronze→Silver→Gold Medallion architecture transformations.
• Ensure gold-layer outputs are performant and consumable by analytics engines.
• Translate engineering specs into scoped tickets and sprint plans.
• Review pull requests and maintain quality across deliveries.

Skills

Data modeling

Leadership

Communication

Agile/ Scrum

Tools

Databricks

PySpark

Spark SQL

Job description

Logicbroker is the Agentic Commerce Orchestration Engine helping enterprise retailers, brands, suppliers, and distributors connect and grow. Our Intelligent Commerce Network powers over $10B in GMV for global leaders like Samsung, Walgreens, and Home Depot by automating the entire process from discovery to doorstep and stock to dock. We make products discoverable, shoppable, fulfillable, and returnable so our clients can grow faster, delight customers, and run smarter operations.

Job Summary

We are hiring aLead Data Engineerto drive delivery across our analytics and data platform initiatives. This role is a hands-on technical lead responsible for translating well-defined engineering specifications into executable work, coordinating a small team of contractors, and ensuring consistent, high-quality progress.You will partner closely with an Engineering Manager who owns architectural direction and high-level specifications. Your focus will be execution leadership: refining specifications into agile workloads, assigning work intelligently, contributing directly to complex implementations, and clearly communicating progress, risks, and clarity needs.

What You'll Do:

• Lead a small delivery team and act as a player-coach by owning the most complex data transformations and modeling work, while reviewing and guiding contractor contributions.
• Keep work unblocked, well-scoped, and on track to ensure consistent delivery of momentum.
• Continue building and refining analytics foundations driven by Gold-layer data models.
• Design and implement Medallion architecture transformations (Bronze → Silver → Gold).
• Ensure Gold-layer outputs are well-modeled, performant, and consistently consumable by an external analytics engine.
• Improve the reliability, clarity, and maintainability of existing pipelines.
• Partner with the Engineering Manager to execute an approved Data Warehouse Unification Plan RFC.
• Plan and deliver sprint-based execution, with execution as the primary focus given the RFC is already defined.
• Work across multiple Databricks instances as part of a GDPR-first data strategy.
• Surface execution risks, sequencing concerns, and dependencies early to support successful delivery.
• Translate engineering specifications into clear, scoped tickets, logical sprint plans, and well-sequenced workstreams.
• Assign work appropriately across contractors based on skill level and complexity.
• Implement complex Spark and Databricks transformations directly as needed.
• Review pull requests and uphold quality standards across all delivered work.
• Communicate progress, blockers, and clarity needs clearly and proactively with stakeholders.
• Maintain delivery momentum without unnecessary process overhead.

What We Need:

• Strong hands-on experience with Databricks, PySpark, and Spark SQL
• Solid data modeling skills, especially for analytics and reporting use cases
• Experience leading delivery for small engineering teams (formal management not required)
• Comfort working with partially defined requirements and refining them collaboratively
• Clear written and verbal communication skills in a remote environment

Nice to Have

• Exposure to multi-region or multi-tenant data platforms
• Familiarity with external analytics tools consuming warehouse data
• Familiarity with various data flows, with sources in Azure, AWS, GCP, and others

Why Logicbroker

Mission-Driven Culture:

Be part of a company transforming digital commerce through innovation and agility—your work directly shapes how global brands connect with customers.

Collaborative, No-Ego Environment:

We believe the best ideas win, not the loudest voices. You’ll work alongside teammates who challenge and support each other.

Hybrid Flexibility with High-Performance Energy:

Whether remote or in-office, we foster autonomy and accountability—because we trust you to own your success.

Leadership That Listens:

Our executives are not just accessible—they’re invested in your growth, open to your ideas, and committed to building a company where people thrive.

Celebrated Wins, Shared Learnings: