Data Engineer: Scale ETL Pipelines & Data Platforms

Wattpad; Toronto; Hybrid; CAD 100,000 - 140,000; Full time

Benefits offered by this job

Hybrid work model

Job summary

Wattpad, a leading webnovel platform, is seeking a Data Engineer for a 12-month fixed-term contract in Toronto. You will build and scale ETL pipelines, collaborate with data scientists and engineers, and design robust data infrastructure across AWS services.

Hybrid work is available, with in-office 3x per week. Required: 4+ years in data engineering, Python and PySpark proficiency, and experience with Spark, Airflow, AWS EMR/Glue, Redshift, and Kafka.

Qualifications

• 4+ years of data engineering experience.
• Ability to write high-quality code in Python and PySpark.
• Strong understanding of database fundamentals and software engineering principles.
• Strong understanding of Data Contracts, microservices principles, and treating datasets/platforms as API-driven products.
• Deep understanding of Spark, Airflow, AWS EMR, AWS Glue, Sagemaker and Redshift.
• Experience with batch processing and streaming systems.
• Exposure to Kafka or other queuing technologies.
• Quantitative, analytical thinking and attention to detail.

Responsibilities

• Coordinate with data scientists, analysts, engineers and product managers to design and evolve our data architecture.
• Build, maintain and scale ETL pipelines to support data science and analytics needs.
• Design and maintain data infrastructure using AWS services and tools while ensuring scalability and security.
• Write new tools, services, and platforms in Python.
• Research and adopt new technologies to solve data infrastructure challenges.
• Advocate for the adoption of data engineering tools within the team.

Skills

4+ years data engineering

Python

PySpark

Data contracts

API-driven datasets

Analytical thinking

Team collaboration

Tools

Spark

Airflow

AWS EMR

AWS Glue

Sagemaker

Redshift

Kafka

Job description

Wattpad, a leading webnovel platform, is seeking a Data Engineer for a 12-month fixed-term contract in Toronto. You will build and scale ETL pipelines, collaborate with data scientists and engineers, and design robust data infrastructure across AWS services.

Hybrid work is available, with in-office 3x per week. Required: 4+ years in data engineering, Python and PySpark proficiency, and experience with Spark, Airflow, AWS EMR/Glue, Redshift, and Kafka.