Data Lineage Developer

FIRSTMILE - A Meraqui Company; Montreal; On-site; CAD 90,000 - 100,000; Full time

Job summary

A leading company in IT Services is seeking a Data Engineer in Montreal. The role involves promoting information security practices, analyzing data processes, and implementing data lineage frameworks. Ideal candidates will have strong skills in data modeling and governance, with a focus on compliance with data privacy regulations. Join a collaborative environment and contribute to innovative data solutions.

Qualifications

• 3+ years of development experience.
• Experience in data engineering and data governance.

Responsibilities

• Analyze business processes and build data lineage frameworks.
• Collaborate with data governance teams for compliance.

Skills

data lineage

metadata cataloging

data modeling

SQL

Python

Java

analytical skills

communication

Tools

MongoDB

Snowflake

SQL Server

DB2

Job description

3 days ago Be among the first 25 applicants

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from FIRSTMILE - A Meraqui Company

• Promote and enforce awareness of key information security practices, including acceptable use of information assets, malware protection, and password security protocols.
• Identify, assess, and report security risks, focusing on how these risks impact the confidentiality, integrity, and availability of information assets.
• Understand and evaluate how data is stored, processed, or transmitted, ensuring compliance with data privacy and protection standards (GDPR, CCPA, etc.).
• Ensure data protection measures are integrated throughout the information lifecycle to safeguard sensitive information.

Role & Responsibilities:

• Analyze business processes to understand current setup, navigating through multiple systems, products, and coordinating with multiple stakeholders.
• Build and implement data lineage frameworks that track the flow of data across multiple systems, databases, and pipelines.
• Work with stakeholders to define and map the end-to-end flow of data, identifying sources, transformations, destinations, and dependencies.
• Implement solutions to catalog metadata from diverse data sources, including MongoDB, Snowflake, and relational databases (e.g., SQL Server, DB2).
• Collaborate with firmwide data governance teams to ensure that lineage metadata is integrated with Collibra for auditing and compliance purposes.
• Develop processes to monitor data quality and ensure that data lineage tracks and reflects accurate data transformations and business rules.
• Design and implement automation tools and scripts to capture and maintain data lineage information and catalog updates on a scheduled basis.
• Create clear, understandable, and accurate documentation of data lineage for business users and technical teams.
• Identify and resolve issues related to data inconsistencies, lineage discrepancies, or errors in data transformation processes.
• Document technical requirements, specifications, and solutions.

Required skills:

• 3+ years of development experience.
• Experience/exposure in data engineering, data governance, or related fields, with a focus on data lineage and metadata cataloging.
• Strong expertise in data modeling, SQL, Stored Procedures/triggers, etc.
• Good knowledge of OO, data structures, and algorithms.
• Experience with data modeling, ETL pipelines, and data transformation.
• Experience with SQL and relational databases (e.g., Sybase, DB2, SQL Server).
• Proficiency in Python, Java, or other scripting languages for data integration and automation tasks.
• Strong analytical and troubleshooting skills with the ability to solve complex data flow problems.
• Excellent written and verbal communication skills, with the ability to explain technical concepts to non-technical stakeholders.
• Ability to work in a fast-paced, collaborative environment with cross-functional teams.
• Good to have:
• Experience with Collibra.
• Knowledge of metadata management practices, including the ability to extract and catalog metadata from complex data sources such as MongoDB, Snowflake, and relational databases.
• Understanding of data privacy regulations (e.g., GDPR, CCPA) and their impact on data lineage and governance.
• Experience working in Agile teams.

Seniority level: Associate

Employment type: Full-time

Job function: Information Technology, Engineering, and Quality Assurance

Industries: IT Services and IT Consulting

Referrals increase your chances of interviewing at FIRSTMILE - A Meraqui Company by 2x

Get notified about new Data Engineer jobs in Montreal, Quebec, Canada.

Montreal, Quebec, Canada CA$90,000.00-CA$100,000.00 2 days ago

Software Engineer, Intermediate or Senior

Software Engineer (Python) - Up to $200k CAD + Bonus - Elite Tech Firm

Pointe-Claire, Quebec, Canada 2 weeks ago

Junior Software Engineer (1-5 years) - Python or C++ - Hybrid working - Up to $160,000 CAD Base (+Bonus)

Montreal, Quebec, Canada $150,000.00-$230,000.00 1 month ago

Software Engineer - Elite FinTech - Up to $200k CAD First Year Comp - Montreal

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.