Data Architect

Hays; Vancouver; On-site; CAD 100,000 - 130,000; Full time

Job summary

A leading financial services client is seeking a Data Architect to drive the migration of data and analytics platforms to Azure Cloud. This role involves designing a cloud-native data ecosystem, ensuring data governance, and collaborating with cross-functional teams to implement innovative data solutions.

Qualifications

• 7+ years in data architecture or related experience.
• Experience designing data governance frameworks.
• Hands-on experience with CI/CD pipelines.

Responsibilities

• Lead design, implementation, and optimization of data solutions in Azure Cloud.
• Collaborate with teams to enforce data governance frameworks.
• Architect automated, scalable data pipelines with CI/CD practices.

Skills

Python

Data Governance

Collaboration

Problem Solving

Education

Bachelor’s or Master’s degree in Computer Science

Tools

Azure Cloud

Azure Databricks

Apache Spark

Unity Catalog

Purview

CI/CD

Azure DevOps

Git

Jenkins

Job description

Our Financial Services client has an immediate opening for a Data Architect to join their team.

They are embarking on a significant transformation to migrate data and analytics platforms to Azure Cloud. This migration will leverage cutting-edge technologies, including Azure Databricks, Unity Catalog, Apache Spark, Python, Purview, CI/CD pipelines, and Data Governance frameworks. The Data Architect will lead the design and implementation of a cloud-native data ecosystem that enables efficient, scalable, secure, and compliant data management.

This role offers an exciting opportunity to be at the forefront of a major transformation in a leading Canadian financial institution, working with cross-functional teams to innovate and deliver world-class data solutions while ensuring robust data governance practices.

Key Responsibilities:

1. Cloud Data Architecture Design: Lead the design, implementation, and optimization of data solutions within Azure Cloud, utilizing Azure Databricks, Apache Spark, Unity Catalog, and Purview, with a focus on security, scalability, compliance, and cost-efficiency.
2. Data Governance Framework: Collaborate with the Data Governance team to enforce frameworks across the data lifecycle, ensuring compliance with regulations like PIPEDA, OSFI, and FINTRAC, and utilizing Unity Catalog & Purview for cataloging, lineage, and compliance.
3. Data Pipeline Architecture & CI/CD: Architect automated, scalable, and governance-compliant data pipelines, implementing CI/CD practices for deployment, version control, testing, and monitoring.
4. Cloud Migration Strategy: Coordinate with teams to plan and execute migration of data infrastructure to Azure, maintaining governance, security, and compliance.
5. Data Access & Security Management: Use Unity Catalog to define and enforce data access policies, working with security teams to integrate controls and encryption.
6. Databricks & Spark Implementation: Design and manage data pipelines with Databricks Notebooks and Apache Spark, ensuring performance and governance standards.
7. Data Quality & Lineage: Implement data quality checks and ensure data lineage traceability using Purview and other tools.
8. Collaboration & Leadership: Partner with various teams to integrate architecture and governance frameworks, mentoring junior members on best practices.
9. Automation & Optimization: Automate data workflows and optimize performance while ensuring compliance.
10. Documentation & Knowledge Sharing: Document data models, architecture, and best practices; share knowledge to foster a culture of learning and transparency.

Qualifications:

• Bachelor’s or Master’s degree in Computer Science, IT, Engineering, or related field.
• 7+ years in data architecture, engineering, or related experience, with cloud expertise.
• Proficiency in Azure Cloud, Azure Databricks, Apache Spark, Unity Catalog, and Purview.
• Experience designing data governance frameworks ensuring data classification, accessibility, and compliance.
• Hands-on experience with CI/CD pipelines for data workflows.
• Knowledge of data cataloging, metadata management, and data lineage, especially using Purview.
• Preferred certifications: Azure Data Engineer Associate, Azure Solutions Architect Expert, Databricks Certified.
• Experience influencing leadership and driving enterprise data strategy.
• Financial services industry experience and familiarity with relevant regulations are assets.

Technical Skills:

• Python & PySpark for data engineering and automation.
• Apache Spark for distributed processing.
• Data governance expertise with Purview and Unity Catalog.
• Experience with CI/CD tools like Azure DevOps, Git, Jenkins.
• Understanding of data security frameworks in regulated environments.

Personal Attributes:

• Strong communicator with cross-team collaboration skills.
• Analytical problem-solver focused on scalable, compliant solutions.
• Leadership ability to mentor and guide junior team members.

Seniority level: Mid-Senior level

Employment type: Full-time

Job function: Information Technology

Industries: Staffing and Recruiting