Senior Data Engineer

ALLTECH CONSULTING SVC INC; Montreal (administrative region); On-site; CAD 90,000 - 120,000; Full time

Job summary

A leading consulting firm is seeking a Senior Data Engineer in Montreal, Quebec. The role involves designing and managing data solutions using Snowflake, along with migrating data flows and developing ETL processes. Candidates should have 7-10 years of experience in data analysis and engineering, with proficiency in SQL, Python, and ETL tools like Talend and Informatica. This position offers an opportunity to work in a collaborative environment focused on innovative data solutions.

Qualifications

• 7-10 years of data analysis and modeling experience in Snowflake data store.
• Experience with Informatica and Talend ETL tools.
• Proficient in SQL and Python for data processing.
• Strong communication and collaboration skills.

Responsibilities

• Design and manage scalable data solutions in Snowflake.
• Migrate data flows from relational to cloud data store.
• Collaborate on data workflows and transformations.
• Develop ETL processes and maintain Snowflake environments.

Skills

Data analysis

Snowflake

SQL development

Python scripting

Informatica ETL

Talend ETL

Data modeling

Communication skills

Relational databases

Data visualization tools

Education

Bachelor's degree in Computer Science or related field

Master's degree (preferred)

Tools

Snowflake REST API

DB2

Tableau

PowerBI

Job description

Job Description

Experience Level: Level 4 (advanced): 7-10 years

JOB DESCRIPTION

The Corporate Workspace Technology area is currently hiring for the role of Senior Data Engineer for the modernization of tooling enablement function. As a Senior Data Engineer, you will be responsible for design, modelling, development and management of data warehouse objects in Snowflake data store utilizing effective data pipelines such as Talend, Informatica and APIs. The ideal candidate should have the skills listed below but in addition should be a self-driven, dedicated individual who works well in a team and thinks and acts strategically.

KEY RESPONSIBILITIES

• Designing, implementing, managing scalable data solutions using Snowflake environment for optimized data storage and processing.
• Migrate existing data domains/flows from relational data store to cloud data store (Snowflake).
• Identify and optimize new/existing data workflows.
• Identify and implement data integrity practices.
• Integrate data governance and data science tools with Snowflake ecosystem as per practice.
• Support the development of data models and ETL processes to ensure high quality data ingestion in cloud data store.
• Collaborate with team members to design and implement effective data workflows and transformations.
• Assist in the maintenance and optimization of Snowflake environments to improve performance and reduce costs.
• Contribute to proof of concept, documentation and best practices for data management and governance within the Snowflake ecosystem.
• Participate in code reviews and provide constructive feedback to improve team deliverables quality.
• Design and develop data ingestion pipeline using Talend/Informatica using industry best practices.
• Writing efficient SQL and Python scripts for large dataset analysis and building end to end automation process on a set schedule.
• Design, implement data distribution layer using Snowflake REST API.
• Development of Semantic Model in Snowflake and PowerBI is a plus.

SKILLS / QUALIFICATIONS

• Bachelor’s degree in Computer Science, Software Engineering, Information Technology, Management Information Systems or related field required (Master’s degree preferred)
• 7-10 years’ experience in data analysis, data objects development and modeling in Snowflake data store.
• Snowflake REST API experience
• Informatica ETL and Talend ETL experience.
• Efficient SQL queries development and Python scripts development experience.
• Proven ability to work in distributed systems
• Proficiency with relational databases (such as DB2) querying and focus on data transformations.
• Excellent problem-solving skills and team-oriented mindset
• Strong data modelling concepts and schema design on relational data store and on cloud data store
• Strong communication skills both verbal and written. Capable of collaborating effectively across a variety of IT and Business groups, across regions and different roles.
• Familiarity with data visualization tools such as Tableau and PowerBI is a plus.
• Collaborating with data scientists/experts to integrate machine learning models into Snowflake