Remote Senior Data Platform PM: Spark, Lakehouse & MDM

Smile Digital Health; Northern (KY); Hybrid; USD 120,000 - 145,000; Full time

Benefits offered by this job

Remote work

Flexible time off

Health benefits

401K/RRSP

Life and disability

EAP

Job summary

Smile Digital Health seeks a Senior Technical Product Manager to shape the next generation of our data ingestion and management platform. You will lead the transformation of the Data Ingress Engine using Apache Spark, Databricks, and Medallion Lakehouse architecture, and own the MDM and data remediation roadmaps for millions of records.

You will thrive at the intersection of distributed systems, high-volume pipelines, and complex data models, collaborating with engineering to deliver scalable,

Qualifications

• 5+ years of Technical Product Management leading complex backend data platforms or big-data ingestion systems.
• Hands-on distributed computing knowledge with Apache Spark (batch or streaming) and distributed data processing.
• Databricks / Lakehouse expertise with Medallion Architecture (Bronze/Silver/Gold) and Delta Lake/Parquet.
• OLAP/columnar strategy for nested data structures and analytics.
• Experience with MDM, identity resolution, or related governance tools.
• Experience with event-driven architectures, DLQs, and data replay/remediation workflows.
• Proficiency in SQL and Python for data analysis and rule definition.

Responsibilities

• Lead product vision and roadmap for decoupled data ingestion modules and scalable micro-services.
• Productize streaming ingestion pipelines (Kafka/Spark) handling billions of records.
• Define API contracts and integration specs for sources feeding HL7/FHIR/claims data.
• Architect Medallion analytics strategy with Silver/Gold datasets and Delta Lake based OLAP.
• Own MDM requirements and Golden Record creation across large data feeds.
• Design end-to-end error remediation and exception management workflows.

Skills

Technical product management

Distributed computing

Apache Spark

Databricks Lakehouse

SQL

Python

Master Data Management

Data governance

Event-driven

Tools

Kafka

Delta Lake

Parquet

Job description

Smile Digital Health seeks a Senior Technical Product Manager to shape the next generation of our data ingestion and management platform. You will lead the transformation of the Data Ingress Engine using Apache Spark, Databricks, and Medallion Lakehouse architecture, and own the MDM and data remediation roadmaps for millions of records.

You will thrive at the intersection of distributed systems, high-volume pipelines, and complex data models, collaborating with engineering to deliver scalable,