Lead Data Engineer

Scotiabank; Toronto; On-site; CAD 90,000 - 120,000; Full time

Job summary

A leading bank in Toronto seeks an experienced Data Engineer to design and develop data ingestion and transformation solutions. The ideal candidate will have 7+ years of IT experience, including practical data engineering skills in tools like Hadoop and Spark. Strong communication skills and a collaborative agile mindset are essential. This role emphasizes diversity and an inclusive workplace, offering a competitive rewards program and opportunities for professional growth.

Benefits

Diversity and Inclusion initiatives

Tuition assistance

Flexible vacation and sick days

Community engagement programs

Qualifications

• 7+ years of IT experience and 5+ years in data integration, engineering, or analytics.
• Experience with Hadoop, Spark, and SQL is essential.
• Strong communication and presentation skills.

Responsibilities

• Design and implement data ingestion and transformation solutions.
• Work closely with project leads and solution architects.
• Support data integration and analytics in cloud environments.

Skills

Hadoop Hive

Apache Sqoop

Apache Spark

SQL

ETL Development

Talend

Python

Java

Autosys

Tidal

Airflow

Unix/Linux CLI

Shell Scripting

Git

Jenkins

Education

Graduate degree in STEM

Job description

Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.

The Team

Data Engineering Team under Canadian Banking Technology (CBT) Data Services Organization is 25+ team members in Canada, Colombia and India which are responsible for data Engineering, ingestion, transformation and delivery between Canadian Banking source applications and Enterprise data lake (EDL), Enterprise Data Warehouse and Global Data & Analytics Platform.

The role

Data Engineer is expected to design, develop, test, implement and production support of data ingestion, transformation, and extraction to and from Big Data Platforms across the bank using tools and technologies including but not limited to Talend, NPIF, iWay, Hadoop, Spark, Python, Scala, Autosys, Tidal, Airflow and shell scripting.

Incumbent is expected to have 7+ years of overall IT experience and 5+ years of practical hands on experience in the field of data integration, engineering and analytics plus have excellent verbal and written English communication skills and work closely with data engineers, project leads, data & solution architects, data analysts and production support across globe in an agile environment.

Is this role right for you? In this role, you will:

• Champions a customer focused culture to deepen client relationships and leverage broader Bank relationships, systems and knowledge.
• Participate in data engineering and transformation design to ensure highly scalable, extensible, and performant solutions.
• Contribute to data ingestion, transformation and extraction solutions in Enterprise big data platform (EDL) and Global Data & Analytics Platform
• Contribute to data and project design and delivery for some of highly visible and critical projects across bank
• Contribute to translating architecture or design into both logical and physical data models that comply with existing (and evolving) standards and practices.
• Hands on development supporting Data integration, Analytics and Cloud environments.
• Work with the Bank’s data governance program
• Understand how the Bank’s risk appetite and risk culture should be considered in day-to-day activities and decisions.
• Actively pursues effective and efficient operations of his/her respective areas in accordance with Scotiabank’s Values, its Code of Conduct while ensuring the adequacy, adherence to and effectiveness of day-to-day business controls to meet obligations with respect to operational, compliance, AML/ATF/sanctions and conduct risk.
• Champions a high-performance environment and contributes to an inclusive work environment.

Do you have the skills that will enable you to succeed in this role? We’d love to work with you if you have:

• Graduate degree in STEM (science, technology, engineering, mathematics) related discipline is desirable, along with 7+ years of working in IT and 5+ years practical experience in Data Engineering/Integration and Analytics.
• 3+ years of experience in working with Hadoop Hive, Apache Sqoop, Apache Spark
• 3+ years of experience in SQL and ETL Development
• 2+ years of hands-on experience working with Talend
• 2+ years of hands-on experience with Python or Java programming.
• 2+ years of hand on experience with scheduling tools such as Autosys, Tidal, Airflow
• 2+ years of software development (SDLC) experience in Agile Scrum/Kanban methodology
• 2+ years of development production support experience is an asset
• Working experience with DevOps and running Jenkins pipelines
• Strong communication and presentation skills
• Excellent understanding of RDBMS concepts (Oracle, SQL Server, DB2)
• Hands on experience with Unix/Linux Command Line Interface (CLI) and Shell Scripting
• Experience with code repository, version control and code promotion tools such as Git/bitbucket and Jenkins

What's in it for you?

• Diversity, Equity, Inclusion & Allyship - We strive to create an inclusive culture where every employee is empowered to reach their fullest potential, respected for who they are, and are embraced through bias-free practices and inclusive values across Scotiabank. We embrace diversity and provide opportunities for all employee to learn, grow & participate through our various Employee Resource Groups (ERGs) that span across diverse gender identities, ethnicity, race, age, ability & veterans.
• Accessibility and Workplace Accommodations - We value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone. Scotiabank continues to locate, remove and prevent barriers so that we can build a diverse and inclusive environment while meeting accessibility requirements.
• Upskilling through online courses, cross-functional development opportunities, and tuition assistance.
• Competitive Rewards program including bonus, flexible vacation, personal, sick days and benefits will start on day one.
• Community Engagement - no matter where you choose to work from; we offer opportunities for community egagement & belonging with our various programs such as hackathonsand much more!

Location(s): Canada : Ontario : Toronto