Senior Python & Databricks Engineer - Capital Markets

Scotiabank; Toronto; On-site; CAD 90,000 - 120,000; Full time

Benefits offered by this job

Diversity and Inclusion initiatives

Tuition assistance

Flexible vacation and benefits from day one

Community engagement opportunities

Job summary

A leading financial institution is seeking a Lead Software Engineer specializing in Python and data technologies. The role involves collaborating with business teams to develop market-leading solutions, designing data models, and enhancing applications. Candidates should have over 4 years of experience in Python, ETL pipelines, and large-scale applications. The position offers a culture of diversity and inclusion, along with competitive rewards and benefits from day one.

Qualifications

• 4+ years’ experience with Python (PySpark, Pandas).
• 4+ years’ experience with designing scalable ETL pipelines & data modeling.
• 4+ years’ experience developing and maintaining large scale applications.

Responsibilities

• Understand business needs, conduct gap analysis and requirements assessments.
• Deliver and enhance new and current solutions and applications.
• Support the solution in production as needed.

Skills

Python (PySpark, Pandas)

ETL pipelines & data modeling

SQL

DataBricks or Snowflake

Azure/GCP

Airflow or Data Factory

DevOps (CI/CD, Jenkins, Git)

Agile methodology

Education

Bachelor’s degree in computer science or Engineering

Tools

Postgres

MSSQL

Oracle DB

Apache Spark

Apache Kafka

Apache ElasticSearch

Job description

A leading financial institution is seeking a Lead Software Engineer specializing in Python and data technologies. The role involves collaborating with business teams to develop market-leading solutions, designing data models, and enhancing applications. Candidates should have over 4 years of experience in Python, ETL pipelines, and large-scale applications. The position offers a culture of diversity and inclusion, along with competitive rewards and benefits from day one.