Remote Senior Data Engineer - Databricks Lakehouse

Mcgraw Hill; New York (NY); Remote; USD 135,000 - 160,000; Full time

Job summary

McGraw Hill is seeking a Senior Data Engineer for its Data & Analytics team. The role focuses on building scalable data pipelines and architectures on AWS and Databricks, delivering reliable insights across financial, product, and customer domains.

You will design end-to-end data solutions, implement SCDs with Delta Lake, and collaborate with stakeholders using Agile practices. This remote US role offers competitive compensation and benefits.

Qualifications

• 5+ years of data engineering experience with cloud-based data platforms.
• Strong hands-on expertise in Databricks and Delta Lake architectures.
• Experience with SCDs (types 1–3) and lakehouse patterns.
• Proficiency in SQL and Python/Scala for data processing.
• Experience with CI/CD and IaC (Terraform) for data pipelines.

Responsibilities

• Design and deliver data solutions on Databricks with Delta Lake lakehouses.
• Implement Delta Lake MERGE for SCD types 1–3 and maintain a unified lakehouse model.
• Operate Databricks Workflows, job scheduling, and SLA adherence.
• Integrate with Git-based workflows, Jira, and Agile/Kanban delivery.
• Apply Unity Catalog governance and cloud-native lakehouse design on AWS.
• Translate business requirements into production-grade data pipelines.

Skills

Databricks

AWS

Python

SQL

Scala

Spark

Terraform

Git

Jira

Tools

Delta Lake

Unity Catalog

Delta Live Tables

MLflow

Apache Airflow

Databricks SQL

S3

Redshift

Job description

McGraw Hill is seeking a Senior Data Engineer for its Data & Analytics team. The role focuses on building scalable data pipelines and architectures on AWS and Databricks, delivering reliable insights across financial, product, and customer domains.

You will design end-to-end data solutions, implement SCDs with Delta Lake, and collaborate with stakeholders using Agile practices. This remote US role offers competitive compensation and benefits.