Data Engineer Senior Consultant

NTT; Montreal; On-site; CAD 100,000 - 130,000; Full time

Job summary

A global technology firm in Montreal is seeking a Senior Cloud Data Warehouse Engineer. You will play a key role in building next-gen data platforms and managing Snowflake data warehouses. Candidates should have extensive experience in SQL, Python, and Snowflake, along with strong analytical and communication skills. The role involves designing data solutions and overseeing data pipeline frameworks for various business needs.

Qualifications

• 10+ years of experience in data development.
• 7+ years of SQL / PLSQL experience.
• 5+ years developing data solutions on Snowflake.
• 3+ years with Python and data pipelines.

Responsibilities

• Design and manage Snowflake data warehouse.
• Establish best practices for Snowflake usage.
• Assist with testing and deploying data framework.
• Monitor performance and tuning of queries.

Skills

SQL / PLSQL

Python

Snowflake

Data Warehousing

Airflow

Data Pipeline Development

Performance Tuning

Education

Bachelor’s degree in Computer Science

Tools

Snowflake

DBT

Job description

Overview

JOB DESCRIPTION

Req ID : 345525

We are currently seeking a Data Engineer Senior Consultant to join our team in Montreal, Quebec (CA-QC), Canada (CA).

Job Title : Senior Cloud Data Warehouse Engineer

Location : Montreal (day 1 onboarding onsite / in-office presence required 3x / week)

Role Summary

As a Senior Cloud Data Warehouse Engineer, you will be a member of the C3 Data Warehouse team with a focus on building our next-gen data platform used for sourcing and storing data from different technology systems across the firm into a centralized data platform that empowers various reporting and analytics solutions for the Technology Risk functions within Morgan Stanley. In this role you will be primarily responsible for contributing to the development of our Cloud Data Warehouse utilizing Snowflake and Python-based tooling. You will also be responsible for the design and development of our data warehouse utilizing Snowflake capabilities such as data sharing, time travel, Snow Park, workload optimization across analytic and AI use-cases, and the ingestion and storage of structured and unstructured data. You will also work on the integration of our Snowflake data warehouse with existing internal platforms for data quality, data cataloging, data discovery, incident logging, and metric generation. You will be working closely with data warehousing leads, data analysts, ETL developers, infrastructure engineers, and data analytics teams to facilitate the implementation of this data platform and data pipeline framework.

KEY RESPONSIBILITIES

• To design, develop, and manage our Snowflake data warehouse.
• To contribute towards the establishment of best practices for the optimal and efficient usage of Snowflake with tooling like Airflow, DBT and Spark.
• To assist with the testing and deployment of our data pipeline framework utilizing standard testing frameworks and CI / CD tooling.
• To monitor the performance of queries and data loads and perform tuning as necessary.
• To provide assistance and guidance during the QA & UAT phases to quickly confirm the validity of potential issues and to determine the root cause and best resolution of verified issues.

SKILLS / QUALIFICATIONS

• Bachelor’s degree in Computer Science, Software Engineering, Information Technology, or related field required.
• At least 10 years of experience in data development and solutions in highly complex data environments with large data volumes.
• At least 7 years of SQL / PLSQL experience with the ability to write ad-hoc and complex queries to perform data analysis.
• At least 5 years of experience with developing data solutions on Snowflake.
• At least 3 years of data pipelines and data warehousing solutions using Python and libraries such as Pandas, NumPy, PySpark, etc.
• At least 3 years of experience developing solutions in a hybrid data environment (on-Prem and Cloud)
• Hands on experience with Python a must.
• Hands on experience with Airflow (or similar tools like Dagster) a must.
• Snowflake SnowPro Core a must
• Snowflake SnowPro Advanced Architect and Advanced Data Engineer a plus.
• Hands on experience with DBT a plus.
• Experience with performance tuning SQL queries, Spark job, and stored procedures.
• An understanding of E-R data models (conceptual, logical, and physical).
• Understanding of advanced data warehouse concepts (Factless Fact Tables, Temporal Bi-Temporal models, etc.) a plus.
• Strong analytical skills, including a thorough understanding of how to interpret customer business requirements and translate them into technical designs and solutions.
• Strong communication skills both verbal and written. Capable of collaborating effectively across a variety of IT and Business groups, across regions, roles and able to interact effectively with all levels.
• Self-starter. Proven ability to manage multiple, concurrent projects with minimal supervision. Can manage a complex ever changing priority list and resolve conflicts to competing priorities.
• Strong problem-solving skills. Ability to identify where focus is needed and bring clarity to business objectives, requirements, and priorities.

About NTT DATA

NTT DATA is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies.Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure and connectivity. We are one of the leading providers of digital and AI infrastructure in the world. NTT DATA is a part of NTT Group, which invests over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. Visit us at