Snowflake Lead Data Engineer

ODAIA; Mississauga; On-site; CAD 100,000 - 140,000; Full time

Job summary

A leading insurance provider is looking for a hands-on technical leader to develop their Cloud Data Lakehouse platform using Snowflake. This role involves designing scalable data architectures, mentoring a team, and optimizing data workflows. The ideal candidate has deep knowledge of Snowflake, strong Python skills, and excellent communication abilities. Join a dynamic team where your contributions will directly impact the business.

Benefits

Competitive compensation

Flexible work/life balance

Comprehensive rewards program

Qualifications

• Deep experience with Snowflake architecture and performance tuning.
• Strong proficiency in Python and object-oriented programming.
• Ability to lead and mentor a technical team.

Responsibilities

• Lead design and development of data pipelines.
• Mentor team members on best practices.
• Monitor and optimize Snowflake workloads.

Skills

Snowflake platform expertise

Python programming

Data architecture

Problem-solving skills

Communication skills

Tools

SnowSQL

dbt

Apache Spark

Job description

Job Description

What is the Opportunity

This is an opportunity to work at RBC Insurance Active Data Platform team with a group of technology specialists dedicated to deliver solution to Insurance business and clients. We are all in with Agile development, DevOps, Open Source, Software as a Service (SaaS) and modern tools and processes. You will have an opportunity to make a real difference by working on some impactful and meaningful projects.

We are seeking a hands-on technical leader responsible for the design and technical implementation of our Cloud Data Lakehouse platform using Snowflake, leveraging the RBC Lumina Snowflake offering. The successful candidate will guide our team in developing a scalable, secure, and efficient data architecture that meets the organization's growing data needs. This role will focus on the application-level design and implementation, ensuring seamless integration with existing systems, and providing technical leadership to the development team.

Our applications are used by RBC staff and clients making your contributions highly impactful and visible, directly contributing to the success of RBC. We deliver digitally enabled applications that are both internal and internet facing. We build cloud data lakehouse, stable web, and back-end applications which are resilient, scalable and high performance that avoids failure and focused on delivering best client experience. We continuously update our tech skills and upgrade our platforms to match industry standards.

What will you do?

• Lead the design and development of scalable and robust data ingestion and transformation pipelines using tools like data build tool (dbt), Python/Snowpark and Snowflake-native features (Snowpipe, Tasks, Streams).
• Guide and mentor a team of data engineers, providing technical direction, conducting code reviews, and enforcing engineering best practices.
• Proactively monitor and tune the performance of Snowflake workloads, including query optimization, Virtual Warehouse sizing, clustering, and micro-partitioning strategies to manage cost and efficiency.
• Working with the Data Architect to implement data quality frameworks, ensuring data integrity and consistency throughout the entire data lifecycle.
• Manage and automate the deployment of Snowflake objects.
• Own the day-to-day operations of the data platform, including troubleshooting pipeline issues, managing dependencies, and ensuring high availability.
• Partner with the solution architect to translate high-level designs into concrete implementation plans and collaborate with data analysts and data scientists to understand the needs.
• Identify potential new and innovative technologies which could benefit RBC Insurance and build, test and assess feasibility for current or future use.
• Ability to determine alternative methods and processes in order to best support RBC Insurance Application and Data needs.

What do you need to succeed?

Must Have

• Deep, hands-on experience with all aspects of Snowflake platform, including its architecture, SQL, SnowSQL, Tasks, Streams, Stages, and performance tuning features.
• Strong proficiency in Python, with experience in libraries like Pandas and a solid understanding of object-oriented programming. Experience with Snowpark is a major plus.
• Strong understanding of cloud concepts on cloud-based data platforms (Snowflake, AWS, Azure, or GCP), especially regarding storages and security.
• Proven ability to lead a technical team, mentor junior engineers and drive technical excellence.
• Excellent communication and interpersonal skills, with the ability to work effectively with technical and non-technical stakeholders.
• Strong problem-solving skills, with the ability to analyze complex technical issues and develop creative solutions.
• Experience on multiple projects with multiple interfaces and/or third parties. Successfully and simultaneously managed multiple projects with emphasis on High Impact, High Business Risk, Uncertain Business Requirements and New Technology.

Nice to Have

• Experience with RBC Lumina Snowflake offering.
• Knowledge of data engineering tools, such as Apache Beam, Apache Spark, or AWS Glue.
• Familiarity with agile development methodologies and version control systems (e.g., Git).
• Certification in Snowflake, data architecture, or a related field.
• Adaptability, Critical thinking and growing mindset.
• Management and collaboration skills, Verbal and written communication skills.
• Team contributor and care about team members.
• Stay relevant to the current industry trend.

What’s in it for you?

• A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable.
• Leaders who support your development through coaching and managing opportunities.
• Ability to make a difference and lasting impact.
• Work in a dynamic, collaborative, progressive, and high-performing team.
• A world-class training program in financial services.
• Flexible work/life balance options.
• Opportunities to do challenging work.
• Opportunities to take on progressively greater accountabilities.
• Opportunities to building close relationships with clients.
• Access to a variety of job opportunities across business and geographies.

RBC is an inclusive workplace that values diversity and equal opportunity. We strive to deliver this through policies and programs intended to foster a workplace based on respect, belonging and opportunity for all.