Senior Data Engineer - Databricks & Lakehouse

Mcgraw Hill; United States; Remote; USD 140.000 - 200.000; Vollzeit

Zusammenfassung

McGraw Hill is seeking a Senior Engineer to join the Insights and Personalization Engineering team to build reporting and personalization features at scale on our Open Learning platform. This role focuses on data engineering in Databricks for Symphony, powering reports for teachers and administrators.

You will own data pipelines and analytics models in our Databricks lakehouse, collaborating with backend, UI, product, and data platform teams to deliver insights at scale for educators.

Aufgaben

• Translate business requirements into technical specifications and solution designs, partnering with product and engineering leaders
• Build and maintain scalable batch and incremental data pipelines using PySpark, Spark SQL, Delta Lake, and Databricks Workflows
• Design reporting data models using dimensional modeling and medallion (bronze/silver/gold) architecture
• Build and optimize the SQL serving layer in Unity Catalog, including views, materialized views, and table-valued functions
• Tune Spark and SQL performance and manage compute cost
• Own data quality, observability, and reliability through automation, testing, and monitoring
• Apply data governance and access controls through Unity Catalog
• Lead design reviews and mentor engineers on data engineering best practices

Jobbeschreibung

McGraw Hill is seeking a Senior Engineer to join the Insights and Personalization Engineering team to build reporting and personalization features at scale on our Open Learning platform. This role focuses on data engineering in Databricks for Symphony, powering reports for teachers and administrators.

You will own data pipelines and analytics models in our Databricks lakehouse, collaborating with backend, UI, product, and data platform teams to deliver insights at scale for educators.