Data Analyst - Expert

Raise; Toronto; Hybrid; CAD 124,000 - 145,000; Full time

Job summary

Raise in Toronto is seeking a Data Analyst - Expert to join a top client project. The role offers hybrid work in a regulated environment with a six-month contract and extension potential.

You will develop data solutions using ADF, Databricks, Azure Functions, Python, and Spark, build end-to-end pipelines, manage Unity Catalog, and implement CI/CD practices across Azure DevOps and GitHub.

Qualifications

• 7+ years of experience with ADF, Databricks, and Azure Functions.
• Deep Python/notebook experience on Databricks/Spark.
• Expert Unity Catalog and data governance setup.
• Experience migrating Databricks Hive Metastore to Unity Catalog.
• Creating delta table schema with proper design and security.
• CI/CD and deployment pipelines using Azure DevOps/GitHub.
• Experience with Azure Entra ID for SSO/RBAC.
• Experience with Azure PaaS resources (Azure SQL, ADF/SHIR, ADLS, Databricks, Synapse).

Responsibilities

• Develop and maintain data solutions using ADF, Databricks, Azure Functions, Python, and Spark.
• Build ADF-to-Databricks data pipelines using Medallion Architecture and Delta Lake.
• Design and manage Unity Catalog, data governance, security, and permissions.
• Migrate Databricks environments from Hive Metastore to Unity Catalog.
• Create and manage Delta tables, schemas, and data security configurations.
• Implement CI/CD and deployment pipelines using Azure DevOps/GitHub Enterprise.
• Work with Azure services including ADLS, Azure SQL, Synapse, ADF/SHIR, and Databricks.
• Perform performance tuning, cost optimization, monitoring, and troubleshooting.
• Lead a small team, conduct technical problem-solving sessions, and work independently.
• Collaborate effectively with stakeholders using strong communication skills.

Skills

Communication skills

Leadership

Independent work

Problem solving

Tools

ADF

Databricks

Azure Functions

Python

Spark

Unity Catalog

Delta Lake

Azure DevOps

GitHub

Azure SQL

Synapse

Hive Metastore

Job description

We at Raise are hiring a Data Analyst - Expert for one of our top clients. After establishing themselves as an industry leader, they're now expanding their team to meet rising demand.

• Location: Toronto, ON - (Hybrid 1- Thursday and 4th Friday of the month - may change due to business requirements)
• Pay Rate: $89.88/hr -$103.89/hr
• Contract Length: 6 Months with possibility for extension

Responsibilities

• Develop and maintain data solutions using ADF, Databricks, Azure Functions, Python, and Spark.
• Build ADF-to-Databricks data pipelines using Medallion Architecture and Delta Lake.
• Design and manage Unity Catalog, data governance, security, and permissions.
• Migrate Databricks environments from Hive Metastore to Unity Catalog.
• Create and manage Delta tables, schemas, and data security configurations.
• Implement CI/CD and deployment pipelines using Azure DevOps/GitHub Enterprise.
• Work with Azure services including ADLS, Azure SQL, Synapse, ADF/SHIR, and Databricks.
• Perform performance tuning, cost optimization, monitoring, and troubleshooting.
• Lead a small team, conduct technical problem-solving sessions, and work independently.
• Collaborate effectively with stakeholders using strong communication skills.

Must Have Requirements

• 7+ Years experience with ADF, Databricks and Azure Functions (C#)
• In depth development experience python/notebook on Databricks/Spark/panda
• Expert working knowledge of Unity Catalog and data governance setup/configuration
• Experience in loading datasets from various sources using ADF to Databricks with Medallion architecture
• Experience on converting Databricks workspace from hive metastore to unity catalog & setup associated permissions
• Creating delta table schema/tables with proper design/properties & security permissions
• DevOps & deployment pipeline using Azure DevOps/GitHub Enterprise for both ADF and databricks
• In depth experience on Azure Entra ID for SSO/RBAC setup
• In depth experience on working with/deploying to Azure PaaS resources such as Azure SQL PaaS, ADF/SHIR, ADLS, Databricks, Synapse dedicated SQL databases
• Familiar to work in lock down windows environment for highly regulated industry
• Ability to work independently and lead a small team.
• Proven ability to work independently with minimum supervision
• Ability to lead a small team and technical problem-solving sessions
• Excellent Communication skills
• ADF orchestrations with Databricks.
• Databricks (Python notebooks, jobs, clusters, Delta Lake, medallion architecture, performance tuning/cost optimization)
• CI/CD, security
• Monitoring

Nice To Have Skills

• Previous Banking experience or experience in a financial institution.
• Nice to have experience on Delta Live Table.
• Financial Services Industry experience is an Asset.

We strive to build teams that reflect the diversity of the communities we work in. We encourage all qualified applicants to apply, including people from traditionally underrepresented groups such as women, visible minorities, Indigenous peoples, people identifying as LGBTQ2SI, veterans, and people with visible/nonvisible disabilities.

We have a dedicated webpage for accommodations where you can learn more about what we offer and request accommodation: https://raise.jobs/accommodations/