Lead Data Engineer

Logicbroker; New York (NY); On-site; USD 140,000 - 190,000; Full time

Job summary

Logicbroker is seeking a Lead Data Engineer to drive analytics and data platform initiatives. This hands-on technical lead will translate engineering specs into executable work, coordinate contractors, and ensure high-quality progress, partnering with an Engineering Manager on architectural direction.

The role emphasizes execution leadership, refining specs into agile workloads, and clear communication of progress and risks.

Qualifications

• Strong hands-on experience with Databricks, PySpark and Spark SQL.
• Proven experience implementing Medallion architecture.
• Experience leading delivery for small engineering teams.
• Comfortable working with partially defined requirements and refining them.
• Excellent written and verbal communication skills.

Responsibilities

• Lead a small delivery team and act as a player-coach by owning the most complex data transformations and modeling work, while reviewing and guiding contractor contributions.
• Keep work unblocked, well-scoped, and on track to ensure consistent delivery of momentum.
• Continue building and refining analytics foundations driven by Gold-layer data models.
• Design and implement Medallion architecture transformations (Bronze -> Silver -> Gold).
• Ensure Gold-layer outputs are well-modeled, performant, and consumable by an external analytics engine.
• Improve the reliability, clarity, and maintainability of existing pipelines.
• Partner with the Engineering Manager to execute a Data Warehouse Unification Plan RFC.
• Plan and deliver sprint-based execution with RFC-defined scope.
• Work across multiple Databricks instances as part of a GDPR-first data strategy.
• Translate engineering specifications into tickets and sprint plans.
• Assign work across contractors based on skill and complexity.
• Implement complex Spark and Databricks transformations as needed.
• Review pull requests and uphold quality standards.
• Communicate progress, blockers, and clarity needs clearly with stakeholders.
• Maintain delivery momentum with minimal overhead.

Skills

Databricks

PySpark

Spark SQL

Medallion architecture

Data modeling

Team leadership

Requirement refinement

Communication

Job description

About Logicbroker, Inc.

Logicbroker is the Agentic Commerce Orchestration Engine helping enterprise retailers, brands, suppliers, and distributors connect and grow. Our Intelligent Commerce Network powers over $10B in GMV for global leaders like Samsung, Walgreens, and Home Depot by automating the entire process from discovery to doorstep and stock to dock. We make products discoverable, shoppable, fulfillable, and returnable so our clients can grow faster, delight customers, and run smarter operations.

About Logicbroker, Inc.

Logicbroker is the Agentic Commerce Orchestration Engine helping enterprise retailers, brands, suppliers, and distributors connect and grow. Our Intelligent Commerce Network powers over $10B in GMV for global leaders like Samsung, Walgreens, and Home Depot by automating the entire process from discovery to doorstep and stock to dock. We make products discoverable, shoppable, fulfillable, and returnable so our clients can grow faster, delight customers, and run smarter operations.

Job Summary

We are hiring a Lead Data Engineer to drive delivery across our analytics and data platform initiatives. This role is a hands‑on technical lead responsible for translating well‑defined engineering specifications into executable work, coordinating a small team of contractors, and ensuring consistent high‑quality progress. You will partner closely with an Engineering Manager who owns architectural direction and high‑level specifications. Your focus will be execution leadership: refining specifications into agile workloads, assigning work effectively, contributing directly to complex implementations, and clearly communicating progress, risks, and areas requiring clarification. At Logicbroker, AI‑driven development isn't a future initiative. Our engineering team has been an early adopter, building its own AI implementations and integrating emerging technologies into everyday development workflows. We're looking for a technical leader who is excited to embrace AI‑assisted development, drive engineering efficiency, and help shape how we continue to innovate and deliver at scale.

Work Authorization

Applicants must be legally authorized to work in the United States. Logicbroker is unable to provide employment visa sponsorship for this position, now or in the future.

What You'll Do

• Lead a small delivery team and act as a player‑coach by owning the most complex data transformations and modeling work, while reviewing and guiding contractor contributions.
• Keep work unblocked, well‑scoped, and on track to ensure consistent delivery of momentum.
• Continue building and refining analytics foundations driven by Gold‑layer data models.
• Design and implement Medallion architecture transformations (Bronze -> Silver -> Gold).
• Ensure Gold‑layer outputs are well‑modeled, performant, and consistently consumable by an external analytics engine.
• Improve the reliability, clarity, and maintainability of existing pipelines.
• Partner with the Engineering Manager to execute an approved Data Warehouse Unification Plan RFC.
• Plan and deliver sprint‑based execution, with execution as the primary focus given the RFC is already defined.
• Work across multiple Databricks instances as part of a GDPR‑first data strategy.
• Surface execution risks, sequencing concerns, and dependencies early to support successful delivery.
• Translate engineering specifications into clear, scoped tickets, logical sprint plans, and well‑sequenced workstreams.
• Assign work appropriately across contractors based on skill level and complexity.
• Implement complex Spark and Databricks transformations directly as needed.
• Review pull requests and uphold quality standards across all delivered work.
• Communicate progress, blockers, and clarity needs clearly and proactively with stakeholders.
• Maintain delivery momentum without unnecessary process overhead.

What We Need

• Strong hands‑on experience with Databricks, PySpark, and Spark SQL
• Proven experience implementing Medallion architecture
• Solid data modeling skills, especially for analytics and reporting use cases
• Experience leading delivery for small engineering teams (formal management not required)
• Comfort working with partially defined requirements and refining them collaboratively
• Clear written and verbal communication skills Nice to Have:
• Experience supporting GDPR‑compliant data strategies
• Exposure to multi‑region or multi‑tenant data platforms
• Familiarity with external analytics tools consuming warehouse data
• Familiarity with various data flows, with sources in Azure, AWS, GCP, and others

Why Logicbroker

Mission‑Driven Culture: Be part of a company transforming digital commerce through innovation and agility - your work directly shapes how global brands connect with customers.

Collaborative, No‑Ego Environment: We believe the best ideas win, not the loudest voices. You’ll work alongside teammates who challenge and support each other.

Flexibility with High‑Performance Energy: Whether remote or in‑office, we foster autonomy and accountability - because we trust you to own your success.

Leadership That Listens: Our executives are not just accessible—they’re invested in your growth, open to your ideas, and committed to building a company where people thrive.

Celebrated Wins, Shared Learnings: From team offsites to Slack shoutouts, we celebrate progress and learn from setbacks together