Senior Data Engineer

Compunnel, Inc.; Mississauga; Hybrid; CAD 120,000 - 160,000; Full time

Job summary

Compunnel, Inc. in Mississauga, Canada is seeking a Senior Data Engineer to design, develop, and maintain scalable data solutions within financial and regulatory domains.

You will lead end-to-end data architecture, integrate diverse data sources, ensure data quality, and collaborate with global teams on complex data pipelines using Python, SQL, PySpark, Snowflake, and Databricks.

Qualifications

• 10+ years of IT experience.
• Advanced Python, SQL Server, Data Warehousing (DWH), Azure Databricks, and PySpark.
• Strong understanding of relational databases, ETL processes, and data modeling.
• Banking domain experience required.
• At least 3 days onsite in a week; local candidates preferred.
• Expertise in system design, architecture, and implementing robust data pipelines.
• Hands-on experience with data validation, quality checks, and automation tools (Autosys, Control-M).
• Effective communication skills for collaboration with business analysts, users, and global teams.

Responsibilities

• Collaborate with business stakeholders to gather technical specifications and translate business requirements into robust technical solutions.
• Design and optimize data models and schemas for efficient integration and analysis.
• Lead application development using Python, PySpark, SQL, Snowflake, and Databricks platforms.
• Implement data validation procedures to maintain high data quality standards.
• Conduct comprehensive testing (UT, SIT, UAT) in coordination with business and QA teams.
• Provide ongoing support, troubleshooting, and maintenance in production environments.
• Contribute to architecture and design discussions to ensure scalable and maintainable data solutions.

Skills

Python

PySpark

SQL

Data modeling

ETL

Banking domain knowledge

On-site collaboration

Tools

Snowflake

Databricks

Autosys

Control-M

Job description

We are seeking a highly skilled Senior Data Engineer with extensive experience in designing, developing, and maintaining scalable data solutions within financial and regulatory domains.

The ideal candidate will lead end-to-end data architecture initiatives, integrate diverse data sources, and ensure data quality and accuracy across systems.

This role requires strong technical expertise, problem-solving skills, and the ability to collaborate effectively with global teams.

Key Responsibilities

• Collaborate with business stakeholders to gather technical specifications and translate business requirements into robust technical solutions.
• Design and optimize data models and schemas for efficient integration and analysis.
• Lead application development using Python, PySpark, SQL, Snowflake, and Databricks platforms.
• Implement data validation procedures to maintain high data quality standards.
• Conduct comprehensive testing (UT, SIT, UAT) in coordination with business and QA teams.
• Provide ongoing support, troubleshooting, and maintenance in production environments.
• Contribute to architecture and design discussions to ensure scalable and maintainable data solutions.

Required Qualifications

• Overall, 10 years of IT experience.
• Advanced proficiency in Python, SQL Server, Data Warehousing (DWH), Azure Databricks, and PySpark.
• Strong understanding of relational databases, ETL processes, and data modeling.
• Must have recent Banking domain experience.
• At least 3 days onsite in a week is required (Prefer Local candidates)
• Expertise in system design, architecture, and implementing robust data pipelines.
• Hands-on experience with data validation, quality checks, and automation tools (Autosys, Control-M).
• Effective communication skills for collaboration with business analysts, users, and global teams.

Preferred Qualifications

• Experience with Snowflake.
• Strong problem-solving and analytical skills.
• Familiarity with financial and regulatory domain requirements.