Data Engineer

CDAI; Toronto; Hybrid; CAD 90,000 - 130,000; Full time

Benefits offered by this job

Hybrid work model

Bonus program

4 weeks vacation

RRSP match

Job summary

CDAI, the innovation arm of Compass Group NA, is seeking a Data Engineer to join the Data Technology team in Toronto. You will design, build, and maintain scalable data pipelines and APIs using Python, SQL, Airflow, Spark, and AWS to deliver reliable data solutions.

Collaborate with Data Scientists and Analytic Engineers, ensure data quality and observability, and evaluate new technologies. Familiarity with Iceberg, EMR, Snowflake, Docker, Kubernetes is a plus.

Qualifications

• 3–5 years of experience in Data Engineering or similar role.
• Strong programming skills in Python and SQL.
• Hands-on experience with AWS, Airflow, and Spark.
• Experience with Iceberg, EMR, and Snowflake is preferred.
• Bachelor's degree or equivalent in Computer Science / Information Systems.

Responsibilities

• Design, build, and maintain scalable ETL/ELT data pipelines using Python, SQL, Airflow, Spark in AWS.
• Build and maintain Airflow DAGs for reliable pipelines.
• Develop and maintain data APIs and integrations across various data sources.
• Work with EMR, Iceberg, and Snowflake to support data processing and analytics.
• Ensure data quality, observability, and monitoring across pipelines.

Skills

Python

SQL

AWS

Airflow

Spark

Education

Bachelor's degree in Computer Science / Information Systems

Tools

Docker

Kubernetes

Snowflake

EMR

Iceberg

Job description

CDAI is an organization that drives innovation for Compass Group NA, an $18 billion food hospitality organization. Compass Group serves over 3 billion meals per year in award winning restaurants, corporate cafes, hospitals, schools, arenas, museums, and more. As the innovation branch of Compass Group, we’re custom-built for fast-paced transformation at the intersection of hospitality and technology. We’re focused on delivering the best experiences possible for our customers and consumers.

WHAT WE DO

We are a team of high performing problem solvers with the same vision: to drive the digital future in hospitality. As digital experts we are focused on building a diverse set of products and solutions for our consumers. Our core products include mobile apps, self-serve kiosks, POS and delivery. We also invest in areas like AI, IoT and frictionless retail. Here we work with the “art of the possible” ideas, where we explore and develop the future of hospitality and technology.

THE ROLE

We are looking for a Data Engineer to join our Data Technology team and help build and maintain scalable data pipelines and APIs. You’ll work with a modern technology stack and collaborate closely with internal and external stakeholders, Data Scientists, and Analytic Engineers to deliver reliable, scalable data solutions.

WHAT YOU'LL DO

• Design, build, and maintain scalable ETL/ELT data pipelines using Python, SQL, Airflow, Spark that hosted in AWS environment.
• Build and maintain Airflow DAGs, ensuring pipeline reliability and performance.
• Develop and maintain data APIs and integrations across a variety of data sources.
• Work with EMR, Iceberg, and Snowflake to support modern data processing and analytics.
• Ensure data quality, observability, and monitoring across pipelines using tools such as Secoda.
• Implement data quality checks and monitoring to identify and resolve data issues proactively.
• Prototype and evaluate new technologies that unlock innovative data-driven consumer experiences.
• Support stakeholders with data-related technical issues and needs.
• Experience with Docker, Kubernetes, Spark, Snowflake, CI/CD a bonus

WHAT YOU'LL BRING

• 3–5 years of experience in Data Engineering or a similar role.
• Strong programming skills in Python and SQL.
• Hands-on experience with AWS, Lambda, Airflow, and Spark.
• Experience with Iceberg, EMR, and Snowflake is preferred.
• Strong understanding of data pipelines, data quality, monitoring, and scalable data architectures.
• Bachelor's degree or equivalent experience in Computer Science, Computer Engineering, Information Systems, or a related field.
• Strong communication skills, a collaborative mindset, and a willingness to learn.

GOOD TO HAVE

• Experience with Docker and Kubernetes.
• Experience with real-time/streaming technologies, such as Kafka, Kinesis
• Experience with data observability and quality tools, such as Secoda, Data Dog.
• Experience with CI/CD and modern software development practices.
• Full Time Permanent
• Hybrid: 4 Days in Office
• Benefits: Bonus, 4 Weeks Vacation, Benefits as of Day 1, RRSP Match and more!