Senior Data Engineer

Infinite Computer Solutions; Toronto; On-site; CAD 120,000 - 190,000; Full time

Job summary

A leading company in IT Services and Consulting is seeking a Data Engineer to join their team in Toronto. In this role, you'll manage database solutions and optimize data management processes while ensuring data integrity and availability. This opportunity allows for significant career growth and the chance to lead innovation in data technologies.

Qualifications

• 5+ years of relevant work experience in database administration and data engineering.
• Experience in building scalable data pipelines.
• Strong expertise in both MySQL and Snowflake.

Responsibilities

• Manage and optimize database performance.
• Collaborate with development teams on schema design.
• Proactively improve data platform resiliency.

Skills

MySQL

ETL

Python

SQL

Snowflake

AWS

Apache Airflow

Kubernetes

Linux

Education

Degree in Computer Science

Job description

W2/ FT

Job Overview

This is a great opportunity to learn, grow and become a SME in data management and database optimization in cloud technology, becoming a key player on our infrastructure team. Join our growing organization and you will get the chance to be in the driver seat of innovation and change here at Payfare as we think about new ways to better leverage data in support of our increasing mandate.

As a data engineer, you will be joining a team of mixed background technologists. Our mandate is to provide flexible and stable platform solutions that empower our feature development teams to create the highest quality services for our customers. On an ongoing basis, we expand our developing, testing, and deploying reliability and resiliency features. All of this continues to require a strong backbone of database solution and design facilitating data ingestion / extraction in the most optimized way, while also ensuring data protection, integration, and ensuring data availability.

Responsibilities and Duties

• Strong MySQL experience enabling platform growth and scale.
• Advanced expertise and experience on schema design improvements with both tactical and strategic lens to ensure data ingestion / extraction for our warehouse database, supporting current data functions team, external reports, and operations teams.
• Experience working in collaboration with development teams to optimize schema and queries for new features before they go out into production.
• ETL and Data Lakehouse management expertise required.
• Knowledge and experience related to migrations from MySQL to PostgreSQL would be a definite plus.
• Python highly desirable, to support current ETL ingestion scripts.
• Proactively identify improvements to continually improve platform and data resiliency.
• Analyze system problems including root cause determination and manage any needed recovery process to ensure a quick restoration of service without loss of data.
• Strong attention to detail in all daily activities.

Qualifications and Skills

• Degree in Computer Science, Software Engineering or similar
• 5+ years of relevant work experience
• Experience in the following areas of expertise: database administration, data engineering, ETL data load and ingestion, data classification and normalization, SQL and schema optimization.
• Experience in building fault-tolerant, high performant, scalable, data pipelines, in a large and complex environment, e.g. in financial services.
• Strong expertise in Snowflake, including its various features.
• Experience with various AWS services such as Lambda, Redshift, DMS
• Experience with various Apache tools such as Airflow, Superset, Kafka
• Expertise in Linux system administration, web servers, and networking would be an asset.
• Kubernetes experience would be an asset.
• Experience with implementation of database security hardening best practices, including collaboration among cross-functional teams to encourage safe and zero-trust access.
• Experience with other cloud vendors with similar technologies is a plus
• A deep curiosity that motivates you to keep on top of technical trends and informs your ability to suggest tools and approaches to interesting problems.
• The ability to empathize with and communicate clearly to all the other parts of the business.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Infinite Computer Solutions by 2x

Sign in to set job alerts for “Data Engineer” roles.

Software Engineer, Backend (All Levels / All Teams)

Software Engineer I, Entry Level (Fall 2024-Spring 2025) - Toronto

Toronto, Ontario, Canada CA$120,000 - CA$190,000 1 month ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.