Senior Data Engineer, Databricks — Scale Insights

TrulyHired; Ohio; On-site; USD 130,000 - 180,000; Full time

Job summary

McGraw Hill is seeking a Senior Engineer - Data Engineering to own data pipelines and analytics models in a Databricks lakehouse powering reports across educator-facing platforms.

You will collaborate with backend, UI, product, and data platform teams to shape how insights are delivered to educators, with a focus on scalable pipelines and reliable data serving in a distributed environment.

Qualifications

• 5+ years of software or data engineering experience in a fast-paced environment.
• Experience building production-grade data pipelines on Databricks or equivalent Spark platform in AWS.
• Advanced SQL skills and ability to optimize analytical queries over large datasets.
• Expertise in data warehousing, lakehouse concepts, data modeling, and cloud data architecture.

Responsibilities

• Translate business requirements into technical specifications and designs.
• Build and maintain scalable batch and incremental data pipelines using PySpark, Spark SQL, Delta Lake, and Databricks Workflows.
• Design reporting data models using dimensional modeling and bronze/silver/gold architecture.
• Build and optimize the SQL serving layer in Unity Catalog (views, materialized views, table-valued functions).
• Tune Spark and SQL performance and manage compute cost.
• Own data quality, observability, and reliability through automation, testing, and monitoring.
• Apply data governance and access controls through Unity Catalog.
• Lead design reviews and mentor engineers on data engineering best practices.

Skills

5+ years software/data engineering

Production data pipelines

Advanced SQL

Data warehousing

Data modeling

Cross-functional collaboration

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

PySpark

Spark SQL

Delta Lake

Unity Catalog

AWS data services (S3, Athena, Glue, EMR, Lambda)

Terraform

GitHub Actions

Docker

Kubernetes

Job description

McGraw Hill is seeking a Senior Engineer - Data Engineering to own data pipelines and analytics models in a Databricks lakehouse powering reports across educator-facing platforms.

You will collaborate with backend, UI, product, and data platform teams to shape how insights are delivered to educators, with a focus on scalable pipelines and reliable data serving in a distributed environment.