Data Engineer

SPECTRAFORCE

Toronto

Hybrid

CAD 80,000 - 110,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

A leading financial technology provider in Canada is seeking a Mid-Senior level professional to lead ETL development and manage a Databricks platform for Capital Markets. This role requires strong expertise in Python and SQL, with a focus on delivering seamless data flows and adhering to best practices. Candidates should have experience in the banking or financial sector, particularly in capital markets. The position is a contract role with a hybrid work model, offering opportunities for contributions to technology strategy.

Qualifications

2+ years of experience in Python, SQL, and ETL Processes.
Experience in Databricks/Snowflake and UI Design/Reporting is preferred.
Prior experience in the Banking/Financial industry, especially Capital Markets, is a plus.

Responsibilities

Lead functional design and development of ETL flow for Databricks.
Manage Databricks platform for Capital Markets as a central data hub.
Perform solution design activities and translate requirements into technical design.
Act as the solution lead and ensure alignment with business requirements in design.
Contribute to technology roadmaps that align with business objectives.

Skills

Python

SQL

ETL Processes

Tools

Databricks

Snowflake

SQL Server Integration Service (SSIS)

WebAPI/Rest Services

Messaging Services (Solace/MQ)

Job description

Location

Toronto, ON (Hybrid, 1-2 day per week on-site, while other days will be remote.)

Duration

12+ Months

What You’ll Be Doing

The role is responsible for leading the functional design and development of ETL flow for Databricks across multiple teams. The resource also provides technical leadership to develop steps and standards for the ETL using current best practices.
In the team, the main functionality of the candidate will be to manage a Databricks platform built for Capital Markets to act as a central data hub and analytics tool. The candidate will be in charge of managing ETL for the applications and technologies relating to Global Funding and Resources Management. They will work with different technology to team to enable and simplify data flow into the central Databricks platform while building standards and procedures to follow and ease the transfer of data.

How You’ll Succeed

Ownership and End to End Delivery: Understand the requirements and find avenues to fill any gaps within them. Deploy code changes and unit tests along with assisting BAs to perform functional testing. Assist QA with regression testing and make sure code is part of release timeline/package and instructions are provided to release managers. Finally verify and or assist release manager/management with deployment if necessary.
Strategic Development & Execution: Perform and coordinate solution design activities. Understand the requirements and translate them into system and application design that is aligned with our technology roadmap, using best practices and standards within the team and the enterprise. Design and document the technical functionality, infrastructure, interfaces, and integrations.
Strategy and Roadmap: Contribute to technology roadmaps that are aligned with the bank’s vision, strategy, and business objectives. Lead multiple complex technology solutions while maintaining consistency across the platform, adopting best practices and pushing forward continuous improvements.
Stakeholder Management: Act as the solution lead and interface with the project/technology teams by driving and moderating design review sessions to walk stakeholders through and ensure that the overall design aligns with business requirements as well as architectural directions.

Required Skills and Experience

Critical Requirements (2+ years’ experience)