Senior Databricks Data Engineer (Remote)

Mcgraw Hill; Columbus (OH); Remote; USD 124,000 - 140,000; Full time

Job summary

McGraw Hill is hiring a Senior Software Engineer (Databricks) to own data pipelines and analytics models powering reports for educators and administrators on the Open Learning platform. You will work across product and data platform teams to deliver scalable batch and streaming data solutions in a Databricks lakehouse.

The role focuses on data engineering in Databricks for Symphony, contributing to reports for PRoPL, OpenLearning, MHPlus and more.

Qualifications

• 5+ years of software or data engineering experience.
• 3+ years building production data pipelines on Databricks or equivalent Spark platform in AWS.
• Advanced SQL skills for large datasets.
• Expertise in data warehousing and lakehouse concepts.
• Bachelor's degree in Computer Science or related field.

Responsibilities

• Translate business requirements into technical specs and designs.
• Build and maintain scalable data pipelines using PySpark, Spark SQL, Delta Lake, and Databricks Workflows.
• Design reporting data models using dimensional modeling and medallion architecture.
• Build and optimize the SQL serving layer in Unity Catalog.
• Tune Spark and SQL performance and manage compute cost.
• Own data quality, observability, and reliability through automation and monitoring.
• Apply data governance and access controls via Unity Catalog.
• Lead design reviews and mentor engineers on data engineering best practices.

Skills

PySpark

SQL

Delta Lake

Databricks

Python

Spark SQL

Unity Catalog

GitHub Actions

Education

Bachelor's degree in Computer Science

Tools

Databricks

Unity Catalog

Terraform

GitHub Actions

Docker

Kubernetes

Job description

McGraw Hill is hiring a Senior Software Engineer (Databricks) to own data pipelines and analytics models powering reports for educators and administrators on the Open Learning platform. You will work across product and data platform teams to deliver scalable batch and streaming data solutions in a Databricks lakehouse.

The role focuses on data engineering in Databricks for Symphony, contributing to reports for PRoPL, OpenLearning, MHPlus and more.