Lead Data Engineer, Data Platform & Pipelines (Onsite NYC)

Versant Media; New York (NY); On-site; USD 170,000 - 190,000; Full time

Job summary

Versant Media is seeking a hands-on Lead Data Engineer to guide end-to-end data product engineering, delivering trusted Silver-layer datasets from source systems into the enterprise data platform. This role blends technical leadership with delivery accountability across ingestion, transformation, governance, and team execution.

Based in New York, NY, the position focuses on building scalable data pipelines, data quality, and governance practices to enable Gold-layer analytics and AI consumption.

Qualifications

• 8+ years in data engineering or software/data-platform work, with 2+ years leading engineers or delivery teams.
• Proven design and delivery of enterprise-scale ingestion and transformation pipelines.
• Strong hands-on skills in SQL, Python, Spark/PySpark and modern ELT/ETL patterns.

Responsibilities

• Lead delivery of source-to-Silver data products across the data stack.
• Oversee a distributed/offshore team of Data Engineers and drive delivery commitments.
• Translate roadmaps into engineering plans with milestones and dependencies.
• Design, oversee ingestion, transformation, standardization, orchestration, and publication of data.

Skills

SQL

Python

Spark/PySpark

ELT/ETL

Databricks

Delta Lake

CI/CD

Bronze/Silver/Gold

change-data-capture

Tools

Databricks

Delta Lake

Unity Catalog

Job description

Versant Media is seeking a hands-on Lead Data Engineer to guide end-to-end data product engineering, delivering trusted Silver-layer datasets from source systems into the enterprise data platform. This role blends technical leadership with delivery accountability across ingestion, transformation, governance, and team execution.

Based in New York, NY, the position focuses on building scalable data pipelines, data quality, and governance practices to enable Gold-layer analytics and AI consumption.