Data Engineer: Python & Pandas Data Quality Expert

Capco; Toronto; On-site; CAD 92,000 - 118,000; Full time

Benefits offered by this job

Healthcare & life insurance

RRSP with employer matching

Virtual health care

Employee & Family Assistance Program

Parental leave and wellbeing benefits

Job summary

Capco, in Toronto, is seeking a hands-on Data Engineer to validate, reconcile, and analyze large datasets using Python, Pandas, and NumPy, delivering reliable data quality checks for financial services clients.

You will work with cross-functional teams to develop scalable pipelines, create reports, and continually improve data processing workflows, while focusing on data validation and transformation to drive trusted insights.

Qualifications

• 3-5+ years of experience in Data Engineering, Data Analytics, or Data Quality Engineering.
• Strong hands-on experience with Python, Pandas, NumPy, and SQL.
• Experience working with large structured datasets.
• Experience comparing and reconciling data from multiple sources.

Responsibilities

• Validate and reconcile two or more datasets simultaneously.
• Build Python-based data validation and comparison frameworks.
• Use Pandas and NumPy extensively to analyze, transform, and validate large datasets.
• Develop automated processes to identify missing, duplicate, or inconsistent data.
• Investigate data quality issues and determine root causes.
• Create reports highlighting discrepancies and data quality metrics.
• Collaborate with business, analytics, and engineering teams to resolve data issues.
• Optimize large-scale data processing workflows.
• Receive data extracts from multiple systems.
• Load and process large datasets using Python, Pandas, and NumPy.
• Compare datasets to identify gaps, inconsistencies, and anomalies.
• Build validation rules and automated quality checks.
• Investigate data issues and communicate findings to stakeholders.
• Create reusable scripts and frameworks for ongoing validation activities.
• Support data migration, onboarding, and integration projects.

Skills

Python

Pandas

NumPy

SQL

Data validation

Tools

PySpark

Azure Data Factory

Databricks

Power BI

Git

CI/CD

Cloud platforms (Azure, AWS, GCP)

Job description

Capco, in Toronto, is seeking a hands-on Data Engineer to validate, reconcile, and analyze large datasets using Python, Pandas, and NumPy, delivering reliable data quality checks for financial services clients.

You will work with cross-functional teams to develop scalable pipelines, create reports, and continually improve data processing workflows, while focusing on data validation and transformation to drive trusted insights.