Database Developer

ALLTECH CONSULTING SVC INC; Quebec; On-site; CAD 60,000 - 100,000; Full time

Job summary

Join a forward-thinking company that champions innovation and diversity in technology. This role focuses on enhancing data governance and compliance through automation and meticulous data lineage tracking. As part of a dynamic team, you will collaborate with stakeholders to define data flows and implement solutions that integrate with leading platforms. Your expertise in data engineering and strong analytical skills will be pivotal in resolving complex data issues and ensuring high-quality data management. If you're passionate about leveraging technology to drive business excellence, this opportunity is tailored for you.

Qualifications

• 3+ years of development experience in data engineering or governance.
• Strong expertise in SQL, data modeling, and ETL processes.

Responsibilities

• Analyze business processes and coordinate with stakeholders.
• Build data lineage frameworks and implement solutions for metadata cataloging.

Skills

Data Engineering

SQL

Data Lineage

Metadata Cataloging

Python

Java

ETL Pipelines

Data Modeling

Analytical Skills

Communication Skills

Education

Bachelor's Degree in Computer Science or related field

Tools

MongoDB

Snowflake

SQL Server

DB2

Collibra

Job description

Job Description:

Technology is the key differentiator that ensures that we manage our global businesses and serve clients on a market-leading platform that is resilient, safe, efficient, smart, fast and flexible. Technology redefines how we do business in global, complex and dynamic financial markets. We have a large number of award-winning technology platforms that help to propel our Firm’s businesses to be the top in the market. We have built strong techno-functional teams which partner with our offices globally, taking global ownership of systems and products. We have a vibrant and diverse mix of technologists working on different technologies and functional domains. There is a large focus on innovation, inclusion, giving back to the community, and sharing knowledge.

The Counterparty Data & Regulatory Tech (CDRT) practice area is responsible for the systems that support client and account onboarding, and the distribution of client and account reference data to other business functions across the firm.

The CDRT Data Governance and Control Squad is looking for a talented and experienced professional to join and contribute to automating the collection and cataloging of Metadata and Lineage of data across the firm to enhance data governance and compliance.

JOB DESCRIPTION:
Major Roles & Responsibilities:
• Analyze business processes to understand current setups, navigating through multiple systems and products, and coordinate with stakeholders.
• Build and implement data lineage frameworks that track data flow across systems, databases, and pipelines.
• Collaborate with stakeholders to define and map end-to-end data flow, identifying sources, transformations, destinations, and dependencies.
• Implement solutions to catalog metadata from sources like MongoDB, Snowflake, and relational databases (SQL Server, DB2).
• Work with data governance teams to ensure lineage metadata is integrated with Collibra for auditing and compliance.
• Develop processes to monitor data quality and ensure lineage accuracy reflecting data transformations and business rules.
• Design and implement automation tools/scripts for capturing and maintaining data lineage and catalog updates.
• Document data lineage clearly for both technical teams and business users.
• Resolve issues related to data inconsistencies, lineage discrepancies, or transformation errors.
• Document technical requirements, specifications, and solutions.

Required skills:
• 3+ years of development experience.
• Experience in data engineering, governance, or related fields focusing on data lineage and metadata cataloging.
• Strong expertise in data modeling, SQL, stored procedures/triggers.
• Knowledge of object-oriented programming, data structures, and algorithms.
• Experience with ETL pipelines and data transformation.
• Proficiency in SQL and relational databases (Sybase, DB2, SQL Server).
• Skills in Python, Java, or scripting languages for automation.
• Analytical and troubleshooting skills for complex data flow issues.
• Excellent communication skills to explain technical concepts.
• Ability to work collaboratively in a fast-paced environment.

Good to have:
• Experience with Collibra.
• Knowledge of metadata management and extraction from complex sources.
• Understanding of data privacy regulations (GDPR, CCPA).
• Agile team experience.
• Experience with reference data.