Senior Software Developer - Spark & Database

Houghton Mifflin Harcourt Co; Montreal (administrative region); On-site; CAD 110,000 - 150,000; Full time

Job summary

Houghton Mifflin Harcourt (HMH) is seeking a Senior Software Spark and Database Developer for the Reporting Platform in Montreal. You will build complex queries, optimize Postgres-based data warehouses, and implement ETL processes, while leveraging Spark, Airflow, and cloud services in a fast-paced team.

You will work with AWS/Azure databases, Docker/Kubernetes, and modern DevOps tooling to deliver scalable, reliable data solutions that improve reporting for customers and students worldwide.

Qualifications

• 6+ years of experience as a DB Developer, preferably with Postgres.
• 2+ years of experience with Apache Spark and Scala development.
• 1+ years of experience with Airflow schedulers and Python development.
• Experience with AWS databases (RDS, Aurora) and SQL tooling.
• CI/CD tooling knowledge (Jenkins or Concourse).
• Knowledge of data warehousing, ETL, and data modeling.

Responsibilities

• Implement complex queries and stored procedures to support REST APIs and batch reports.
• Develop and maintain database applications/procedures using SQL and related languages.
• Tune performance and optimize database systems, indexes, and queries.
• Set up and manage Airflow jobs for automated data processing.
• Support Spark-based streaming data processing and Scala development.
• Create data import/export processes and data integration scripts.
• Build solutions using AWS database technologies like RDS Postgres and Aurora.
• Contribute to system architecture for the Reporting Platform.
• Set up monitoring dashboards and alerts with DataDog.
• Troubleshoot database issues and automate recurring tasks.
• Participate in CI/CD deployments with Jenkins or Concourse.

Skills

Apache Spark

Scala

Airflow

Python

SQL

Liquibase

Flyway

Jenkins

Concourse

Data modeling

DataDog

AWS

Azure

Postgres

Redshift

Docker

Kubernetes

Education

BS/MS in Computer Science/Engineering or STEM

Tools

AWS RDS/Aurora

Job description

Title: Senior Software Developer - Spark & Database

Location Designation:

Location: Montreal, QC, CA, H2W 2R2

Job Requisition ID:17433

Additional Locations:

Senior Software Engineer – Spark and Database for the HMH Reporting Platform

HMH Software Engineering

HMH Software Engineering provides cutting edge, individualized learning experiences to millions of students across the United States. We are as driven by this mission as we are by continuously improving ourselves and the way we work. Our offices are high energy, collaborative beehives of activity where work is centered on small, autonomous teams that build great software. We trust each other, hold ourselves and our teammates accountable for results, and improve student outcomes with each release.

At HMH we constantly experiment with new approaches and novel ways of solving problems. We often succeed and sometimes stumble — either way we learn and move forward with more confidence than we had the day before. We are as passionate about new technologies and engineering craftsmanship as we are about transforming the EdTech industry itself.

If this sounds like you let’s talk.

The Opportunity – Senior Software Spark and Database Developer for HMH Reporting Platform

Senior Software Engineers personify the notion of constant improvement as they work with their team to build software that delivers on our mission to improve student outcomes. You ’ re not afraid to try new things even if they don’t work out as expected. You are independent, self-directed, high energy and as eager to contribute to your team as you are to progress on your own path to software craftsmanship. You ’ ll thrive working in a fast-paced, low friction environment where you are exposed to a wide range of cutting‑edge technologies.

Reporting Platform:

Responsibilities:

• Implement complex queries and stored procedures to support REST APIs and batch rollups of reports data for customer organizations.
• Writing, designing, testing, implementing, and maintaining database applications/procedures using SQL or other database programming languages.
• Resolve performance issues, performance tuning of database systems, queries, indexing.
• Use of Apache Airflow scheduler to setup DB jobs to run automatically.
• Supporting streaming event processing using Spark framework with Scala.
• Manage and create data import and export processes (ETL) into the databases and create and manage data integration scripts using file transfers, API calls, and/or other methods.
• Develop solutions using AWS database technologies like RDS Postgres and Aurora Postgres.
• Provide support for systems architecture for Reporting Platform.
• Setting up Monitor Dashboards and Alerts using DataDog to proactively catch issues.
• Diagnose and troubleshoot database errors.
• Create automation for repeating database tasks.
• DevOps knowledge to automate deployments using Jenkins or Concourse.

Skills & Experience

• 6+ years of experience as a DB Developer, preferably with Postgres, creating and supporting commercial data warehouses and data marts.
• 2+ years of experience working with Apache Spark and Scala development.
• 1+ years of experience working with Airflow Schedulers with Python development.
• Plus is experience working with Airflow Schedulers with Python development.
• Strong hands‑on working knowledge of managing databases on AWS Databases including: RDS and Aurora.
• Strong command of SQL. SQL server tools, ETL jobs including stored procedures.
• Database technologies such as SQL, Aurora, Redshift, Liquibase or Flyway
• Cloud technologies such as AWS and Azure
• Data Center Operating Technologies such as Apache Mesos, Apache Aurora, and TerraForm and container services such as Docker and Kubernetes
• Advanced knowledge of database security and performance monitoring standards.
• Understanding of relational and dimensional data modeling.
• Knowledge of DataDog for setting up monitoring and alerting dashboards.
• Working knowledge of Jenkins or Concourse tool for CI/CD.
• Ability to work independently and in a group to provide sound design and technology leadership.
• Self-starter attitude with initiative & creativity.
• Ability to pay attention to details, dealing with interruptions and changing timelines and priorities.
• Ability to communicate and work effectively with all levels of company.
• Related AWS DBA Certification is a preferred.
• Working knowledge of AirFlow is a plus.
• Knowledge of AWS Database Migration Service and Lambda is a plus.

Required Education:

• A BS/MS in Computer Science, Computer Engineering, or a STEM field.

Physical Requirements:

• Might be in a stationary position for a considerable time (sitting and/or standing)
• The person in this position needs to move about inside office to access file cabinets, office machinery, etc
• Constantly operates a computer and other office productivity machinery, such as a calculator, copy machine, and computer printer
• Must be able to collaborate with colleagues via face to face, conference calls, and online meetings

ABOUT US:
Houghton Mifflin Harcourt (NASDAQ:HMHC) is a global learning company dedicated to changing people’s lives by fostering passionate, curious learners. As a leading provider of pre‑K–12 education content, services, and cutting‑edge technology solutions across a variety of media, HMH enables learning in a changing landscape. HMH is uniquely positioned to create engaging and effective educational content and experiences from early childhood to beyond the classroom. HMH serves more than 50 million students in over 150 countries worldwide, while its award‑winning children’s books, novels, non‑fiction, and reference titles are enjoyed by readers throughout the world. Follow HMH on Twitter, Facebook and YouTube. For more information, visit http://careers.hmhco.com

PLEASE NOTE:
Houghton Mifflin Harcourt is an equal employment opportunity employer and participates in E-Verify. All qualified applicants will receive consideration for employment and will not be discriminated against on the basis of gender, race/ethnicity, gender identity, sexual orientation, protected veteran status, disability, or other protected group status.