Data Analyst #107546

C.G. Consulting Group; Toronto; Hybrid; CAD 124,000 - 138,000; Part time

Benefits offered by this job

Hybrid work arrangement

Downtown Toronto office

Job summary

G.G. Consulting Group seeks a Data Analyst with 10+ years of experience to lead advanced data integration using ADF, Databricks and Azure Functions in a regulated environment. The role focuses on Databricks notebooks, Unity Catalog, Delta Lake design, and cost-aware Spark optimization.

You will collaborate with a Data Engineer Lead and BAs, work hybrid from downtown Toronto, and support a six-month contract with potential extension to FTE.

Qualifications

• 7+ years experience with ADF, Databricks and Azure Functions (C#).
• Deep development experience in Python notebooks on Databricks/Spark/Pandas.
• Expert knowledge of Unity Catalog and data governance setup/configuration.
• Experience loading datasets from various sources using ADF to Databricks with Medallion architecture.
• Experience converting Databricks workspace from hive metastore to unity catalog and configuring permissions.

Responsibilities

• Develop and optimize data pipelines using ADF and Databricks.
• Design Delta Lake schemas with proper security and governance.
• Lead DevOps pipelines for ADF and Databricks in Azure DevOps/GitHub Enterprise.
• Collaborate with Data Engineer Lead and BAs on delivery.

Skills

ADF

Databricks

Azure Functions

Python notebooks

Unity Catalog

Data governance

Azure

DevOps

GitHub Enterprise

Tools

Azure DevOps

Azure SQL PaaS

Medallion architecture

Delta Lake

Databricks

ADLS

Unity Catalog

Job description

Data Analyst - ADF, Databricks and Azure #107546

Request ID: 107546-1

Start/End Dates: ASAP for 6 ,omths

Work Location: downtown Toronto, near TTC and GO

Job Title: IT - Data Analyst - Expert

Line of Business: Global Asset Management Technology

Target rate range: $90-100hr B2B

Target Start Date: ASAP

Duration: 6 months

Potential for this contract to be extended or converted to FTE? Extension: Yes / FTE: Yes

Hybrid work: in office on Thursday, plus 4th Friday of the month. (occasional additional days if needed - changes coming based on business need)

Office Location: 81 Bay Street, Toronto

Work Schedule (hours per week, start time): 37.5 Hours/week, 9-5 Monday to Friday

Potential for OT? No

What does the LOB do?

Global Asset Management institutional execution is the process by which asset managers carry out large-scale investment transactions on behalf of institutional clients. This involves optimizing trade strategies, ensuring best pricing, minimizing market impact, and adhering to regulatory requirements to achieve efficient and secure execution of investment decisions.

Highlights of the role; why would someone choose this role over another?

Business is under transformation journey and open to explore advance functionality of databricks.

Who Will the Candidate Be Working with on a Daily Basis?

Data Engineer Lead + BAs

How many years of experience?: 10+

Job Description

• 7+ Years experience with ADF, Databricks and Azure Functions (C#)
• In depth development experience python/notebook on Databricks/Spark/panda
• Expert working knowledge of Unity Catalog and data governance setup/configuration
• Experience in loading datasets from various sources using ADF to Databricks with Medallion architecture
• Experience on converting Databricks workspace from hive metastore to unity catalog & setup associated permissions
• Creating delta table schema/tables with proper design/properties & security permissions
• Nice to have experience on Delta Live Table.
• DevOps & deployment pipeline using Azure DevOps/GitHub Enterprise for both ADF and databricks
• In depth experience on Azure Entra ID for SSO/RBAC setup
• In depth experience on working with/deploying to Azure PaaS resources such as Azure SQL PaaS, ADF/SHIR, ADLS, Databricks, Synapse dedicated SQL databases
• Familiar to work in lock down windows environment for highly regulated industry
• Ability to work independently and lead a small team.
• Proven ability to work independently with minimum supervision
• Ability to lead a small team and technical problem-solving sessions
• Financial Services Industry experience is an Asset.
• Excellent Communication skills

Must Have Requirements

• ADF orchestrations with Databricks,
• Databricks (Python notebooks, jobs, clusters, Delta Lake, medallion architecture, performance tuning/cost optimization)
• CI/CD, security
• Monitoring
• How many years of experience?: 10+

Nice to Have

• Previous CIBC experience or experience in a financial institution.

Soft Skills

• Meticulous
• Attention to detail
• Autonomous

NOTE

Close on Oct 13 at 3PM

G.G. Consulting Group uses advanced ATS systems to track and manage candidates and jobs. We do not use AI tools for candidate screening.