Data Engineer: Build Scalable Pipelines & Warehouses

Spait Infotech; Canada; On-site; CAD 90,000 - 130,000; Full time

Job summary

Spait Infotech is seeking a data engineer to design, build, and maintain scalable ETL/ELT pipelines for batch and streaming data in Canada. You will optimize SQL queries, manage data warehouses and data models, and collaborate with analysts and data scientists to deliver reliable data products.

The role emphasizes data quality, governance, and cost-aware infrastructure, with exposure to cloud platforms and modern data tooling such as Spark, Airflow, and Delta Lake.

Qualifications

• Strong knowledge of SQL, including joins, subqueries, CTEs, and window functions.
• Programming knowledge in Python.
• Understanding of ETL/ELT pipelines and data integration concepts.
• Knowledge of relational databases such as MySQL, PostgreSQL, or SQL Server.
• Understanding of data warehousing, data modeling, and database design.
• Familiarity with file formats such as CSV, JSON, and Parquet.
• Knowledge of data quality checks and pipeline troubleshooting.
• Understanding of distributed data processing concepts.

Responsibilities

• Design, develop, and maintain scalable data pipelines for batch and streaming data.
• Extract, transform, and load data from multiple sources using ETL/ELT processes.
• Develop and optimize SQL queries for data processing and analysis.
• Build data integration workflows using Python and relevant data engineering tools.
• Design and maintain data warehouses, data lakes, and data models.
• Ensure data quality, accuracy, consistency, and reliability.
• Monitor pipeline performance and troubleshoot data processing issues.
• Collaborate with Data Analysts, Data Scientists, and software development teams.
• Implement data validation, monitoring, logging, and error-handling mechanisms.
• Optimize data storage, processing performance, and infrastructure costs.
• Document data pipelines, workflows, and technical processes.
• Follow data security, access control, and governance practices.

Skills

SQL proficiency

Python

ETL/ELT

Relational databases

Data warehousing

Data modeling

CSV/JSON/Parquet

Data quality checks

Distributed data processing

Tools

Apache Spark

Apache Airflow

Snowflake

BigQuery

Redshift

Kafka

Databricks

Delta Lake

Docker

Git

CI/CD

Job description

Spait Infotech is seeking a data engineer to design, build, and maintain scalable ETL/ELT pipelines for batch and streaming data in Canada. You will optimize SQL queries, manage data warehouses and data models, and collaborate with analysts and data scientists to deliver reliable data products.

The role emphasizes data quality, governance, and cost-aware infrastructure, with exposure to cloud platforms and modern data tooling such as Spark, Airflow, and Delta Lake.