Data Engineer

Computer Generated Solutions Canada; Saint John; On-site; CAD 70,000 - 90,000; Full time

Job summary

A leading technology solutions provider in Saint John, NB seeks a skilled Data Engineer. Responsible for designing, implementing, and maintaining data pipelines and optimizing data workflows. Ideal candidates will have a Bachelor's degree in a related field and strong proficiency in tools like Snowflake and Starburst. This role offers a full-time contract, providing opportunities for collaboration and process improvement.

Qualifications

• Proven experience in data engineering, focusing on data migration and ETL processes.
• Solid understanding of database technologies and data governance best practices.
• Experience with Agile methodologies and DevOps practices is a plus.

Responsibilities

• Design and maintain data pipelines for efficient data ingestion and loading.
• Collaborate with teams to implement solutions that meet data requirements.
• Ensure data quality and integrity throughout the migration process.

Skills

Data migration tools

Data engineering

ETL processes

Collaboration

Programming in Python, SQL, or Java

Education

Bachelor’s degree in computer science, Engineering, or related field

Tools

Starburst

Snowflake

Informatica

AWS

Azure

Google Cloud Platform

Job description

Data Engineer – Full time – Contract – 9 months

Computer Generated Solutions – Saint John, NB

Overview

We provide custom learning solutions, channel partner enablement services and applications development. Since 1984, CGS has been delivering expert, cross-industry solutions across multiple platforms. To learn more about us, visit www.cgsinc.com

Job Description

We are seeking a skilled and experienced Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines, as well as optimizing data workflows for efficient data migration and management. Your expertise in data migration tools such as Snowflake and DBT will be essential in ensuring the seamless transfer of data across various platforms and systems. Fivetran experience would be considered an asset.

Responsibilities

• Design, develop, and maintain data pipelines for efficient data ingestion, transformation, and loading (ETL) processes.
• Collaborate with cross-functional teams to understand data requirements and implement solutions that meet business needs.
• Utilize your expertise in data migration tools, including Starburst, Snowflake, and Informatica, to facilitate smooth data migration across platforms.
• Optimize data workflows to improve performance, reliability, and scalability.
• Ensure data quality and integrity throughout the migration process by implementing robust validation and error-handling mechanisms.
• Develop and maintain documentation for data migration processes, including technical specifications, data mappings, and data lineage.
• Stay updated on emerging technologies and best practices in data engineering and make recommendations for process improvements and tool enhancements.
• Provide technical support and troubleshooting assistance to resolve data migration issues and ensure timely delivery of data deliverables.
• Collaborate with data architects, analysts, and other stakeholders to understand data models and translate business requirements into technical solutions.
• Participate in code reviews, knowledge sharing sessions, and continuous learning activities to foster a culture of collaboration and innovation.

Qualifications

• Bachelor’s degree in computer science, Engineering, or a related field; or equivalent work experience.
• Proven experience in data engineering, with a focus on data migration, ETL processes, and data warehousing.
• Strong proficiency in data migration tools such as Starburst, Snowflake, and Informatica.
• Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
• Proficiency in programming languages such as Python, SQL, or Java.
• Solid understanding of database technologies, data modeling principles, and data governance best practices.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills, with the ability to work effectively in a team environment.
• Experience with Agile methodologies and DevOps practices is a plus.
• Relevant certifications in data engineering or cloud computing (e.g., AWS Certified Solutions Architect, Snowflake Certified Professional) are preferred but not required.