Data Engineer: Hybrid Role for Scalable Pipelines

CDAI; Toronto; Hybrid; CAD 90,000 - 130,000; Full time

Benefits offered by this job

Hybrid work model

Bonus program

4 weeks vacation

RRSP match

Job summary

CDAI, the innovation arm of Compass Group NA, is seeking a Data Engineer to join the Data Technology team in Toronto. You will design, build, and maintain scalable data pipelines and APIs using Python, SQL, Airflow, Spark, and AWS to deliver reliable data solutions.

Collaborate with Data Scientists and Analytic Engineers, ensure data quality and observability, and evaluate new technologies. Familiarity with Iceberg, EMR, Snowflake, Docker, Kubernetes is a plus.

Qualifications

• 3–5 years of experience in Data Engineering or similar role.
• Strong programming skills in Python and SQL.
• Hands-on experience with AWS, Airflow, and Spark.
• Experience with Iceberg, EMR, and Snowflake is preferred.
• Bachelor's degree or equivalent in Computer Science / Information Systems.

Responsibilities

• Design, build, and maintain scalable ETL/ELT data pipelines using Python, SQL, Airflow, Spark in AWS.
• Build and maintain Airflow DAGs for reliable pipelines.
• Develop and maintain data APIs and integrations across various data sources.
• Work with EMR, Iceberg, and Snowflake to support data processing and analytics.
• Ensure data quality, observability, and monitoring across pipelines.

Skills

Python

SQL

AWS

Airflow

Spark

Education

Bachelor's degree in Computer Science / Information Systems

Tools

Docker

Kubernetes

Snowflake

EMR

Iceberg

Job description

CDAI, the innovation arm of Compass Group NA, is seeking a Data Engineer to join the Data Technology team in Toronto. You will design, build, and maintain scalable data pipelines and APIs using Python, SQL, Airflow, Spark, and AWS to deliver reliable data solutions.

Collaborate with Data Scientists and Analytic Engineers, ensure data quality and observability, and evaluate new technologies. Familiarity with Iceberg, EMR, Snowflake, Docker, Kubernetes is a plus.