Remote Senior Data Engineer — Real-Time Analytics

Mcgraw Hill; États-Unis; À distance; USD 135 000 - 160 000; Plein temps

Résumé du poste

McGraw Hill is seeking a Senior Data Engineer to advance product eventing, data platforms, and analytics. You will design scalable event pipelines, implement Delta Lake patterns, and ensure data quality from learning interactions to insights.

The role is remote in the United States, collaborating with product managers and data teams. You will work with Databricks, Unity Catalog, and AWS services to build reliable, real-time data solutions, focusing on end-to-end data quality and governance.

Qualifications

• Deep expertise in modern event-driven data and lakehouse architecture with product event design.
• 5+ years in Data Engineering focusing on Databricks and cloud-native data solutions.
• Hands-on experience building scalable event pipelines and data transformations.

Responsabilités

• Define and deliver end-to-end data pipelines connecting learning interactions to insights.
• Design and implement event schemas, Delta Lake, and medallion architecture on AWS.
• Develop and optimize Spark (PySpark/Scala) ETL/ELT pipelines and Databricks Workflows.
• Ensure data quality, monitoring, and alerting across pipelines and data products.
• Collaborate with product/platform teams to translate requirements into robust designs.

Connaissances

Databricks

Delta Lake

Unity Catalog

SQL

Python

Scala

Spark

Kafka

CI/CD

AWS

Outils

Databricks Workflows

Airflow

Delta Sharing

Unity Catalog

Description du poste

McGraw Hill is seeking a Senior Data Engineer to advance product eventing, data platforms, and analytics. You will design scalable event pipelines, implement Delta Lake patterns, and ensure data quality from learning interactions to insights.

The role is remote in the United States, collaborating with product managers and data teams. You will work with Databricks, Unity Catalog, and AWS services to build reliable, real-time data solutions, focusing on end-to-end data quality and governance.