Data Engineer - AWS Data Lake & Pipelines

Houghton Mifflin Harcourt Co; Dublin; On-site; EUR 70,000 - 100,000; Full time

Job summary

Houghton Mifflin Harcourt is seeking a Data Engineer in Dublin to enhance data pipelines into our Enterprise Data Lake and Warehouse using PySpark on AWS Glue, Kafka Connect, and Kinesis Firehose. You will work with learners and educators, bridging data from multiple sources to serve analytics and BI needs.

You’ll partner with data science, learning science and product teams to curate datasets, build dashboards and automate processes while advancing infrastructure-as-code and best practices

Qualifications

• Experience building ETL/data processing pipelines.
• Proficient in Python and Java; Spring Boot beneficial.
• AWS stack experience across key services.
• Knowledge of CI/CD tooling and Terraform.
• Strong SQL and relational databases experience.
• Kubernetes is a plus.

Responsibilities

• Implement data pipelines to populate Enterprise Data Lake/Warehouse.
• Collaborate with data science, learning science and product teams.
• Develop data analytics capabilities and BI dashboards.
• Automate and improve internal processes.
• Promote best practices in deployment and IaC.

Skills

ETL experience

Python

Java

CI/CD tooling

SQL

Kubernetes

Tools

AWS (VPC, S3, Glue, Lambda, Athena, IAM)

Terraform

Concourse

Kafka Connect

Kinesis Firehose

Job description

Houghton Mifflin Harcourt is seeking a Data Engineer in Dublin to enhance data pipelines into our Enterprise Data Lake and Warehouse using PySpark on AWS Glue, Kafka Connect, and Kinesis Firehose. You will work with learners and educators, bridging data from multiple sources to serve analytics and BI needs.

You’ll partner with data science, learning science and product teams to curate datasets, build dashboards and automate processes while advancing infrastructure-as-code and best practices