Senior Data Engineer

EQ Bank | Equitable Bank; Toronto; Hybrid; CAD 80,000 - 110,000; Full time

Job summary

An innovative financial institution is seeking a Senior Data Engineer to enhance its enterprise data warehouse. This role involves designing and developing data pipelines, optimizing data processing scripts, and ensuring efficient data flow and storage on Azure platforms. You'll collaborate with diverse teams to implement best practices in data engineering while tackling complex data challenges. This position offers a hybrid work environment, competitive bonuses, and a comprehensive benefits package, making it an exciting opportunity for those looking to make a significant impact in the banking sector.

Benefits

Competitive bonus

RRSP match

Health benefits

Employee Share Purchase Plan

Parental top-up

Generous vacation

Professional development

Virtual events

Qualifications

• 5+ years of experience as a Data Engineer with Microsoft Azure technologies.
• Proficient in T-SQL, Mapping Dataflow, and Python.

Responsibilities

• Design and develop scalable data pipelines in Azure data platform.
• Implement and maintain API integrations for seamless data flow.

Skills

T-SQL

Python

Azure Data Factory

Mapping Dataflow

Azure Data Lake

REST APIs

Data Warehousing Concepts

Event Hub

Data Modeling

Education

Bachelor's degree in Computer Science or Engineering

Tools

Azure SQL

Synapse Analytics

Function Apps

Logic Apps

Job description

Join a Challenger

Being a traditional bank just isn’t our thing. We are big believers in innovating the banking experience because we believe Canadians deserve better options, and we challenge ourselves and our teams to creatively transform what’s possible in banking. Our team is made up of inquisitive and agile minds that find smarter ways of doing things. If you’re not afraid of taking on big challenges and redefining the future, you belong with us. You’ll get to work with people who will encourage you to reach new heights. We like to keep things fun, ask questions and learn together.

We are a big (and growing!) family. Overall we serve more than 670,000 people across Canada through Equitable Bank, Canada's Challenger Bank, and have been around for more than 50 years. Equitable Bank's wholly-owned subsidiary, Concentra Bank, supports credit unions across Canada that serve more than six million members. Together we have over $125 billion in assets under management and administration, with a clear mandate to drive change in Canadian banking to enrich people's lives. Our customers have named our EQ Bank digital platform (eqbank.ca) one of the top banks in Canada on the Forbes World's Best Banks list since 2021.

The work

• The Senior Data Engineer will be responsible for designing and maintaining the enterprise data warehouse for various projects, as well as providing ongoing support for activities impacting all enterprise databases. The ideal candidate will have hands-on experience with Azure Data Factory, Azure Data Lake, Azure Function App, Logic App, REST APIs, mapping dataflow, and Event Hub. As a key member of our team, you will collaborate with various stakeholders to ensure efficient data flow, storage, and integration, while employing best practices in data engineering.

The Core Responsibilities

• Designing and Developing Data Pipelines (70%)
• Develop and maintain scalable Synapse pipelines for data ingestion, processing, and transformation in Azure data platform.
• Develop and optimize T-SQL and Python-based data processing scripts and integrate them with Synapse pipelines for ETL tasks and data transformations.
• Design and develop mapping dataflow solutions for complex data transformations.
• Develop and maintain data storage solutions, ensuring efficient data retrieval and storage on Azure Data Lake and databases.
• Implement and maintain API integrations, including REST APIs, for seamless data flow between systems.
• Design and test the end-to-end process for data ingestion, transformation, cleansing, delivery, quality, and timeliness.
• Implement and ensure data security and privacy measures, complying with industry standards and regulations.
• Monitor and optimize the performance of Azure data services, Synapse pipelines, Function Apps, and Logic Apps.
• Improve scalability, efficiency, and cost-effectiveness of data pipelines.

Requirements gathering and Technical Documentation (10%)

• Participate in Joint Application Development sessions with business units to gather and understand their data and reporting requirements.
• Create and maintain technical documentation for tools, development, and procedures.

Data Strategy and Planning (10%)

• Provide inputs and assist in enabling Cloud-based data solutions.
• Develop and recommend innovative approaches to solve business and technical problems.
• Collaborate with the larger team to exchange knowledge, solutions, and practices to build a more consistent, robust approach to development.

Support and Maintenance of Enterprise Data Warehouse (10%)

• Continuously improve performance and proactively identify and resolve bottlenecks to reduce build and delivery time.
• Troubleshoot and resolve data-related issues promptly.

Let's talk about you!!

• Bachelor's degree or equivalent in Computer Science or Engineering.
• 5+ years of proven experience as a Data Engineer working with Microsoft Azure technologies.
• Proficient in T-SQL, Mapping Dataflow, and Python.
• Hands-on experience with Azure Data Factory, Data Lake, Function Apps, Logic Apps, Azure SQL, Synapse Analytics, Event Hub.
• Strong understanding of data warehousing concepts and data modeling.
• Experience with structured, semi-structured, and unstructured data.
• Excellent communication and organizational skills.

Nice-to-have

• Azure Data Engineer Associate or Solutions Architect certification.
• Experience with DevOps, CI/CD, data quality routines, and financial industry.
• Knowledge of big data tech like Apache Spark.

What we offer [For full-time roles]

• Competitive bonus, RRSP match, health benefits, Employee Share Purchase Plan, parental top-up, generous vacation, virtual events, professional development, and more.

The role involves hybrid work at 2200-25 Ontario Street, Toronto, ON.

Equitable Bank values inclusion and diversity, providing accommodations and a fair recruitment process. Candidates must pass background and credit checks. We look forward to meeting you!