Lead Data Engineer - Databricks, Spark, Medallion

Logicbroker; New York (NY); Hybrid; USD 140,000 - 190,000; Full time

Job summary

Logicbroker is hiring a Lead Data Engineer to drive analytics and data platform initiatives. This hands‑on technical lead role involves translating specs into executable work, coordinating contractors, and ensuring high‑quality progress.

You will partner with an Engineering Manager on architectural direction and execution leadership. You will own complex data transformations, refine requirements, and deliver scalable data pipelines across Databricks and Spark environments, while communicating

Qualifications

• Strong hands‑on experience with Databricks, PySpark, and Spark SQL.
• Proven ability to design analytics data models for reporting.
• Experience leading delivery for small engineering teams.

Responsibilities

• Lead a small delivery team and act as a player‑coach for complex data work.
• Coordinate contractors, refine specs into agile workloads, and track progress.
• Design Medallion architecture transformations (Bronze-Silver-Gold).
• Ensure Gold‑layer outputs are well modeled and consumable by analytics tools.
• Plan sprint execution and communicate risks and blockers clearly.

Skills

Delivery leadership

Data modeling

Communication

Tools

Databricks

PySpark

Spark SQL

Job description

Logicbroker is hiring a Lead Data Engineer to drive analytics and data platform initiatives. This hands‑on technical lead role involves translating specs into executable work, coordinating contractors, and ensuring high‑quality progress.

You will partner with an Engineering Manager on architectural direction and execution leadership. You will own complex data transformations, refine requirements, and deliver scalable data pipelines across Databricks and Spark environments, while communicating