Senior Data Engineer

Compass Digital; Ontario; On-site; CAD 80,000 - 120,000; Full time

Job summary

A leading technology firm is seeking a Senior Data Engineer to design and develop innovative AI solutions and scalable data products. You will work collaboratively with a talented team, utilizing web scraping and cloud-native backend systems to empower data analysis and application development. This position promises to offer a dynamic and progressive environment for professional growth in the AI domain.

Qualifications

• 2+ years of experience developing AI and data products.
• Strong knowledge of Python and scraping frameworks like Playwright.
• Excellent written and verbal communication skills.

Responsibilities

• Design and maintain Playwright-based web scraping systems.
• Collaborate with cross-functional teams to ship new features.
• Ensure data quality and compliance across scraping processes.

Skills

Python

Scraping frameworks / libraries

Problem-solving

Attention to detail

Communication

Education

Bachelor's degree in a STEM field

Tools

Playwright

BeautifulSoup

Requests

Git

Job description

Get AI-powered advice on this job and more exclusive features.

We are looking for a passionate Senior Data Engineer to join our team at Compass Digital. You will design, develop, and maintain cutting-edge data products and AI solutions, focusing on making difficult-to-access data sources available through web scraping and document scanning. Collaborating with Data Scientists, Analytics Engineers, Front-End Engineers, ML Engineers, and AI Engineers, you will build cloud-native backend systems and infrastructure for new AI-powered applications. Your work will lay the foundations for a new product delivering Data Analytics and AI capabilities.

Responsibilities include :

• Design, build, and maintain scalable, Playwright-based web scraping systems to extract data from dynamic and complex web sources
• Collaborate with cross-functional teams to define, design, and ship new features
• Architect efficient, reusable backends for scraping and AI workflows in the cloud
• Write clean, well-documented, and maintainable code following best practices
• Conduct code reviews, provide constructive feedback, and mentor junior team members
• Stay up-to-date with emerging AI technologies and industry trends to drive continuous improvement
• Ensure data quality, resilience, and compliance across scraping processes
• Work in a dynamic, collaborative, progressive, and high-performing team
• Interact with multiple cross-functional teams, gaining exposure to various components of modern data technology

Qualifications for success :

• Bachelor's degree in a STEM field or equivalent experience
• Strong experience with Large Language Models (LLMs)
• 2+ years of hands-on experience in developing AI and data products
• Strong knowledge of Python and scraping frameworks / libraries (e.g., Playwright, BeautifulSoup, Requests)
• Strong cloud engineering skills with experience deploying AI solutions to production
• Familiarity with proxy rotation, CAPTCHA solving, and session management in automated scraping
• Familiarity with RESTful APIs
• Knowledge of version control systems such as Git and agile development methodologies
• Excellent problem-solving skills, attention to detail, and ability to work independently or within a team
• Excellent written and verbal communication skills, capable of conveying complex concepts to non-technical audiences
• Seniority level : Associate
• Employment type : Full-time
• Job function : IT Services and IT Consulting, Software Development, Food and Beverage Services

Referrals increase your chances of interviewing at Compass Digital by 2x.

Apply now to set job alerts for “Data Engineer” roles.

Location : Richmond Hill, Ontario, Canada. Posted 1 month ago.