Sr. Data Engineer

Iris Software Inc.; Toronto; Hybrid; CAD 90,000 - 120,000; Full time

Job summary

A leading company in the financial sector is seeking a Senior Data Engineer for a long-term contract in Toronto. The role involves designing and optimizing data pipelines, ensuring data integrity, and collaborating with various stakeholders. Ideal candidates will have hands-on experience with PySpark, Databricks, and Apache Airflow, and a strong understanding of cloud environments.

Qualifications

• Hands-on experience with PySpark, Databricks, and Apache Airflow.
• Mid-Senior level position requiring collaboration with data teams.

Responsibilities

• Designing and optimizing scalable data pipelines for analytics.
• Integrating data from various sources and ensuring data integrity.

Skills

PySpark

Databricks

Apache Airflow

Data Pipeline Design

ETL/ELT Development

Data Integration

Cloud Optimization

CI/CD Automation

Job description

Direct message the job poster from Iris Software Inc.

Sr Associate - Hiring Specialist at Iris Software Inc.

Iris’s client, one of the Top 5 Banks in Canada, is looking to hire a Senior Data Engineer for a long-term contract opportunity.

Our client is a US multinational financial services company and the largest bank in Canada by market capitalization. The bank serves over 17 million clients and has more than 89,000 employees worldwide. It offers a full range of banking, investing, asset management, and other financial and risk-management products and services to individual consumers, small and middle-market businesses, and large corporations.

Location: Toronto, ON (Hybrid)

Duration: Long Term

Required Skills

• Hands-on experience with PySpark, Databricks, and Apache Airflow.
• Designing, building, and optimizing scalable data pipelines and workflows for business intelligence, analytics, and machine learning.
• Developing and maintaining ETL/ELT pipelines using PySpark on Databricks.
• Implementing workflow orchestration with Apache Airflow, including scheduling, monitoring, and error handling.
• Integrating data from relational databases, APIs, and cloud storage platforms.
• Optimizing data transformation processes for performance and cost in cloud environments (Azure or AWS preferred).
• Collaborating with data scientists, analysts, and stakeholders to ensure data quality and timeliness.
• Ensuring data integrity through validation and testing frameworks.
• Automating CI/CD processes for data pipelines.

Thanks and Regards,

Iris Software

200 Bay St., Toronto, ON, M5J 2J2

www.irissoftware.com

Additional Details

• Seniority level: Mid-Senior level
• Employment type: Contract
• Job function: Information Technology
• Industries: IT Services and IT Consulting

Referrals increase your chances of interviewing at Iris Software Inc. by 2x.

Get notified about new Data Engineer jobs in Toronto, Ontario, Canada.