Sr. Data Engineer - IMCO

Red Pico; Toronto; Hybrid; CAD 100,000 - 120,000; Full time

Job summary

A financial services organization in Toronto is looking for a Sr. Data Engineer for a 6-month hybrid contract. You will leverage your expertise in Azure and Databricks to design and support data pipelines crucial for investment decisions. The ideal candidate has at least 7 years of experience in data warehousing and ETL processes. This position offers exposure to senior executives in a dynamic environment.

Qualifications

• Minimum 7 years of experience in data warehousing.
• Expert experience in ETL processing using Azure.
• Hands-on experience with data modeling and SQL scripting.

Responsibilities

• Design, build, and support cloud-based data infrastructure.
• Prototype solutions in collaboration with business stakeholders.
• Maintain and improve data pipelines for analytical functions.

Skills

Data warehousing design

Complex SQL

Power BI reports

ETL processing

Azure data solutions

Databricks

Dimensional data models

Continuous integration/deployment

Agile practices

Education

Undergraduate degree in Computer Science or Engineering

Tools

Azure Data Factory

Snowflake

Apache Hive

AWS

Job description

Investment Management Corporation of Ontario

Description

Client is looking for a Sr. Data Engineer on a 6-month contract to start. This team is called front office analytics and works very closely with the business. This person is coming in on a BAU capacity this team works closely with the business to prototype solutions. The Business consultant on the team are actually technical modelers that can code in python. They then pass to the Data engineer for production and for them t run it through a proper platform like databricks and make it to code standard.

The Senior Data Engineer will work closely with the Business System Analysts and stakeholders from Front Office Analytics to design build and support the cloud-based infrastructure for the data pipeline including maintenance improvement cleansing and manipulation of data and analytics across IMCO s data platforms.

• Minimum 7 years of experience in data warehousing designing complex SQL queries tables views and procedures including performance tuning and query optimization.
• Undergraduate degree in Computer Science or Engineering or other related discipline with experience building and maintaining IT data operations in asset management or investment.
• Experience in building complex Power BI reports including data model in Power BI
• Expert experience in ETL processing using tools Azure Data Factory SSIS and Airflow
• Senior-level experience in operationalizing data platforms with Azure data solutions such as Azure Databricks Azure Analysis Service Azure Synapse
• Experience in development with Databricks and Snowflake
• Solid experience in building and maintaining dimensional data models.
• Hands-on experience with source control management systems and continuous integration / deployment
• Ability to self-direct manage priorities and meet deadlines.
• Superior tactical analytical evaluative and problem-solving abilities to translate business requirements into technical specifications.
• Good understanding of agile practices with demonstrated experience in operating in Kanban or Scrum for delivery.
• Eagle PACE knowledge is highly desirable.

Must Have :

working in Data engineering with the Azure technology stack preferably in conjunction with Snowflake data warehouse

2. Experience working with Databricks in order to store analyze and share data ( This will be 80% of the role)

3. Azure data factory / ADLS experience that will help them migrate data important for business users

Nice to Have :

1. Snowflake Experience

2. Investment Management / Capital markets Experience

Workplace Type

Hybrid

Experience Level

This individual will be supporting BAU initiatives for IMCOs front office. This is a crucial role as front office contains key functions that allows IMCO to run and be successful. They require correct data so that the traders can make accurate investment decisions. This individual will have exposure to a buy-side client and work can front office experience and knowledge which is very desirable within the financial services world.

• Small fast paced environment (start up mentality)
• lots of exposure to senior executives.
• In office 2 days a week

Additional Skills & Qualifications

Contribute to designing and implementation of data architecture and technology infrastructure for new data and analytics platform with Databricks and Snowflake data stack

Build custom services and workflows to provide functionality when required to complement existing tools i.e. convert to ingestible formats call external web services and third-party APIs

Create database objects with a strong understanding of data modeling.

Write complex SQL for ETL and data extractions with high-performance and easy-to-manage code.

Develop and maintain automated build and deployment processes for all solutions using cloud tools and CI / CD practices.

Develop functional specifications and systems configuration documentation to support solution rollout

Start Date

Interview Information

1 (1-hour interview)

1 (30-min interview)

Business Challenge

Tight timelines for the migration project which has caused challenges with the existing teams their are dependences on this work so it needs to be completed. The organization doesnt fully understand the technical aspects of data governance

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Employment Type : Full Time

Experience : years

Vacancy : 1

Create a job alert for this search

Sr Data Engineer • Toronto, Ontario, Canada