Data Engineer

Compass Data & AI; United States; Hybrid; USD 63,000 - 84,000; Full time

Benefits offered by this job

Bonus

Benefits from Day 1

4 weeks vacation

RRSP match

Job summary

Compass Data & AI is seeking a Data Engineer to join the Data Technology team to build and maintain scalable data pipelines and APIs. You will collaborate with Data Scientists and Analytic Engineers to deliver reliable data solutions.

You’ll work with Python, SQL, Airflow, Spark, and AWS in a modern tech stack, focusing on data quality, observability, and proactive issue resolution. In-office collaboration and hybrid work are supported.

Qualifications

• 3–5 years of experience in Data Engineering or a similar role.
• Strong programming skills in Python and SQL.
• Hands-on experience with AWS, Lambda, Airflow, and Spark.

Responsibilities

• Design, build, and maintain scalable ETL/ELT data pipelines on AWS.
• Build and maintain Airflow DAGs for reliability and performance.
• Develop data APIs and integrations across sources.
• Work with EMR, Iceberg, and Snowflake to support analytics.
• Ensure data quality, observability, and monitoring across pipelines.

Skills

Python

SQL

Airflow

Spark

AWS

Lambda

Docker

Kubernetes

CI/CD

Data pipelines

Education

Bachelor's degree in Computer Science/Engineering/IS

Tools

Snowflake

EMR

Iceberg

Secoda

DataDog

Job description

We are looking for a Data Engineer to join our Data Technology team and help build and maintain scalable data pipelines and APIs. You’ll work with a modern technology stack and collaborate closely with internal and external stakeholders, Data Scientists, and Analytic Engineers to deliver reliable, scalable data solutions.

WHAT YOU'LL DO

• Design, build, and maintain scalable ETL/ELT data pipelines usingPython, SQL, Airflow, Spark that hosted in AWS environment.
• Build and maintainAirflow DAGs, ensuring pipeline reliability and performance.
• Develop and maintaindata APIsand integrations across a variety of data sources.
• Work withEMR, Iceberg, and Snowflaketo support modern data processing and analytics.
• Ensuredata quality, observability, and monitoringacross pipelines using tools such asSecoda.
• Implement data quality checks and monitoring to identify and resolve data issues proactively.
• Prototype and evaluate new technologies that unlock innovative data-driven consumer experiences.
• Support stakeholders with data-related technical issues and needs.
• Experience with Docker, Kubernetes, Spark, Snowflake, CI/CD a bonus

WHAT YOU'LL BRING

• 3–5 years of experiencein Data Engineering or a similar role.
• Strong programming skills in Python and SQL .
• Hands-on experience with AWS, Lambda, Airflow, and Spark .
• Experience with Iceberg, EMR, and Snowflake is preferred.
• Strong understanding of data pipelines, data quality, monitoring, and scalable data architectures.
• Bachelor's degree or equivalent experience in Computer Science, Computer Engineering, Information Systems , or a related field.
• Strong communication skills, a collaborative mindset, and a willingness to learn.

GOOD TO HAVE

• Experience with Docker and Kubernetes .
• Experience with real-time/streaming technologies , such as Kafka, Kinesis
• Experience with data observability and quality tools , such as Secoda, Data Dog.
• Experience with CI/CD and modern software development practices.

ROLE DETAILS:

• Full Time Permanent
• 4 in Office Days a Week
• Perks: Bonus, Benefits as of Day 1, 4 weeks of vacation, RRSP Match and more!
• Location: 1 Prologis Blvd, Mississauga / 72 Fraser Avenue, Toronto