Senior Databricks Data Engineer - Scale Insightful Reports

Mheducation; Ohio; On-site; USD 124,000 - 160,000; Full time

Job summary

McGraw Hill is seeking a Senior Software Engineer focused on Databricks data engineering to build scalable pipelines and analytics for Open Learning. You will own data models and reporting layers used by educators, with collaboration across backend, UI, product, and data platform teams.

Responsibilities include designing dimensional models, optimizing Spark/SQL, governance via Unity Catalog, and mentoring others. Strong AWS, Databricks, and Delta Lake expertise are required.

Qualifications

• 5+ years software or data engineering experience, including production data pipelines on Databricks or Spark in AWS.
• Strong SQL skills with performance tuning for large datasets.
• Experience delivering production-grade software in a distributed environment.
• Bachelor’s degree in CS or related field.

Responsibilities

• Own data pipelines and analytics models in Databricks lakehouse powering reports.
• Translate business requirements into designs and partner with product teams.
• Build and maintain scalable batch and incremental data pipelines using PySpark and Delta Lake.
• Design reporting data models using dimensional modeling and bronze/silver/gold architecture.
• Tune Spark/SQL performance and manage compute costs.
• Ensure data quality, observability, and reliability via automation and monitoring.
• Apply data governance through Unity Catalog and lead design reviews.
• Mentor engineers on data engineering best practices.

Skills

PySpark

SQL

Data pipelines

Delta Lake

Unity Catalog

REST APIs

Education

Bachelor's degree in CS

Tools

Databricks

Delta Lake

Unity Catalog

Spark SQL

Job description

McGraw Hill is seeking a Senior Software Engineer focused on Databricks data engineering to build scalable pipelines and analytics for Open Learning. You will own data models and reporting layers used by educators, with collaboration across backend, UI, product, and data platform teams.

Responsibilities include designing dimensional models, optimizing Spark/SQL, governance via Unity Catalog, and mentoring others. Strong AWS, Databricks, and Delta Lake expertise are required.