Data Engineer

Scotiabank; Toronto; Hybrid; CAD 90,000 - 130,000; Full time

Benefits offered by this job

Bonus

Flexible vacation

Personal days

Benefits starting day one

Job summary

Scotiabank is seeking a Data Engineer to design, build, and operate scalable data pipelines across Azure and Databricks in a Toronto-based team. You will develop ETL/ELT processes, ensure data quality, and enable reliable data products for analytics and decision-making.

The role emphasizes collaboration with product, architecture, platform, and business teams, adherence to governance and security standards, and contributing to DevOps practices in an enterprise banking environment.

Qualifications

• 4+ years of experience with data warehouses, data lakes, lakehouse platforms, or enterprise data platforms.
• 4+ years of ETL/ELT design, development, and support.
• Experience with structured, semi-structured, and unstructured data.
• Proficient in SQL development, performance tuning, and data modeling.
• Hands-on Python programming for data engineering tasks.
• Experience with Azure cloud data services and Databricks.
• Familiarity with dbt, Airflow, and CI/CD practices.
• Strong collaboration and communication with stakeholders.

Responsibilities

• Design, build, test, deploy, and support scalable data pipelines across Azure and Databricks environments.
• Ingest, transform, validate, and distribute data across structured, semi-structured, and unstructured formats.
• Develop reusable data engineering frameworks, patterns, and standards to improve delivery efficiency.
• Implement data quality, lineage, validation, and observability capabilities.
• Collaborate with product, architecture, platform, and business teams to translate requirements into solutions.
• Support data governance and access control through Unity Catalog and security practices.
• Drive DevOps and CI/CD adoption for data pipelines and automation.
• Troubleshoot production issues and continuously improve pipeline performance.

Skills

Python programming

SQL development

Data modeling

Spark

Airflow

Data pipelines

Communication

Education

Bachelor's or higher in CS/Engineering/IT

Tools

Azure Databricks

Unity Catalog

dbt

GitHub

CI/CD pipelines

Terraform

Job description

Requisition ID: 270031
Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.

The Data Engineer will play a critical role in designing, building, and supporting scalable, secure, and resilient data solutions across enterprise cloud data platforms. This role will focus on modern data engineering practices, including Azure, Databricks, Unity Catalog, ETL/ELT pipeline development, dbt-based transformation, CI/CD automation, and data platform modernisation.

The successful candidate will work closely with business stakeholders, product teams, data architecture, platform engineering, and application teams to deliver reliable data pipelines and high-quality data products that support reporting, analytics, operational decision-making, and enterprise data initiatives.

Is this role right for you? In this role, you will:

• Design, build, test, deploy, and support scalable data pipelines across Azure and Databricks environments.
• Develop ETL and ELT processes to ingest, transform, validate, and distribute structured, semi-structured, and unstructured data.
• Build and optimise data pipelines using Azure cloud services, Databricks, Spark, Unity Catalog, dbt, and related data engineering tools.
• Work with stakeholders, product managers, architects, and platform teams to understand business requirements and translate them into reliable technical solutions.
• Design ingestion patterns and onboard new data sources into the enterprise cloud data platform.
• Implement data quality, reconciliation, validation, lineage, and observability capabilities to ensure data accuracy, reliability, and traceability.
• Develop reusable data engineering frameworks, patterns, and standards to improve delivery efficiency and operational stability.
• Support data governance and access control through Unity Catalog, platform security standards, and enterprise risk management practices.
• Create and maintain technical design documentation, including logical and physical data flow views, pipeline designs, operational runbooks, and implementation details.
• Drive adoption of DevOps and engineering best practices, including GitHub-based source control, CI/CD pipelines, automated testing, code reviews, and deployment governance.
• Troubleshoot production issues, perform root cause analysis, and continuously improve pipeline performance, reliability, and scalability.
• Collaborate with DevOps, Scrum, product, application, and business teams to deliver data products in an Agile delivery model.
• Contribute to roadmap planning, delivery tracking, technical discussions, and stakeholder communications where required.

Do you have the skills that will enable you to succeed in this role? We'd love to work with you if you have:

Core Data Engineering Experience

• 4 + years of experience working with data warehouses, data lakes, lakehouse platforms, or enterprise data platforms.
• 4+ years of experience designing, developing, and supporting ETL/ELT data pipelines.
• Strong experience working with structured, semi-structured, and unstructured data.
• Hands-on experience with data ingestion, transformation, validation, reconciliation, and distribution patterns.
• Strong understanding of data modelling, SQL development, performance tuning, and pipeline optimisation.
• Experience building resilient, scalable, and maintainable data engineering solutions for enterprise environments.

Azure and Databricks

• Strong hands‑on experience with Azure cloud data services, including Azure Data Lake Storage, azure data factory, and related cloud‑native data platform components.
• Strong experience with Databricks, Spark, Delta Lake, and lakehouse architecture.
• Practical experience with Unity Catalog for data governance, access control, metadata management, and secure data sharing.
• Experience with Databricks Auto Loader, workflow orchestration, notebook development, job scheduling, and production‑grade pipeline deployment.
• Understanding of cloud security, access management, data protection, and enterprise governance standards.

DBT, ETL/ELT, Airflow and Data Transformation

• Hands‑on experience with dbt for data transformation, modular SQL development, testing, documentation, and deployment.
• Strong understanding of ELT design patterns, incremental models, reusable transformation logic, and data quality checks.
• Ability to design transformation layers that are maintainable, auditable, and aligned with enterprise data standards.

Programming and Technical Skills

• Strong Python programming and scripting experience for data engineering and automation.
• Working knowledge of Java and/or Scala, especially in Spark or big data processing environments.
• Experience with shell scripting or automation scripting is an asset.
• Strong debugging, problem‑solving, and performance tuning skills.

CI/CD and Engineering Practices

• Hands‑on experience with GitHub for source control, branching, pull requests, code reviews, and release management.
• Experience building or working with CI/CD pipelines for data engineering delivery.
• Experience with DevOps practices, automated testing, deployment automation, and environment promotion.
• Familiarity with Terraform, infrastructure‑as‑code, or cloud deployment automation is an asset.
• Experience working in Agile/Scrum delivery teams.

Communication and Collaboration

• Strong communication skills with the ability to explain complex technical concepts to both technical and non‑technical stakeholders.
• Ability to translate business requirements into scalable technical solutions.
• Experience leading or actively contributing to technical discussions, design reviews, and implementation planning.
• Collaborative mindset with the ability to work across data, application, platform, DevOps, product, and business teams.
• Demonstrated ownership, accountability, and a track record of successful delivery in enterprise technology environments.

Nice to Have

• Experience in banking, financial services, regulatory, or highly governed enterprise environments.
• Experience with data lineage, metadata management, data quality frameworks, and observability tools.
• Experience with enterprise reporting, analytics, AI/ML enablement, or operational data products.
• Knowledge of application integration patterns, APIs, microservices, or event‑driven architecture.
• University degree in Computer Science, Engineering, Data Engineering, Information Technology, or equivalent practical experience.

What's in it for you?

• Diversity, Equity, Inclusion & Allyship - We strive to create an inclusive culture where every employee is empowered to reach their fullest potential, respected for who they are, and are embraced through bias‑free practices and inclusive values across Scotiabank. We embrace diversity and provide opportunities for all employee to learn, grow & participate through our various Employee Resource Groups (ERGs) that span across diverse gender identities, ethnicity, race, age, ability & veterans.
• Accessibility and Workplace Accommodations - We value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone. Scotiabank continues to locate, remove and prevent barriers so that we can build a diverse and inclusive environment while meeting accessibility requirements.
• Upskilling through online courses, cross‑functional development opportunities, and tuition assistance.
• Competitive Rewards program including bonus, flexible vacation, personal, sick days and benefits will start on day one.
• Dynamic Ecosystem - Free tea & coffee, universal washrooms, and lots of space for team collaboration.
• Community Engagement - No matter where you choose to work from; we offer opportunities for community engagement & belonging with our various programs.

Location(s): Canada : Ontario : Toronto
Scotiabank is a leading bank in the Americas. Guided by our purpose: "for every future", we help our customers, their families and their communities achieve success through a broad range of advice, products and services, including personal and commercial banking, wealth management and private banking, corporate and investment banking, and capital markets.

At Scotiabank, we value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone. If you require accommodation (including, but not limited to, an accessible interview site, alternate format documents, ASL Interpreter, or Assistive Technology) during the recruitment and selection process.

We thank all applicants for their interest in a career at Scotiabank; however, only those candidates who are selected for an interview will be contacted.

Job Segment: Database, SQL, Engineer, Computer Science, Developer, Technology, Engineering