Dataform Engineer/Architect

VTRAC Consulting Corporation; Toronto; Hybrid; CAD 80,000 - 100,000; Full time

Job summary

A consulting firm specializing in data solutions is seeking a Dataform Engineer/Architect in Toronto. The role involves designing and optimizing data pipelines on Google Cloud Platform, developing reusable SQLX workflows, and ensuring data quality. Candidates should have over 5 years of experience in data engineering, a strong skill set in SQL, Dataform, and Google Cloud, alongside a Bachelor's degree in a relevant field. This position offers a six-month contract with remote work options.

Qualifications

• 5+ years of experience in data engineering, with focus on SQL and cloud-based platforms.
• Strong experience with Dataform and GCP, including BigQuery.
• Excellent communication and collaboration skills.

Responsibilities

• Design and develop data pipelines using Dataform and SQL on GCP.
• Optimize and manage BigQuery environments for performance and costs.
• Collaborate with stakeholders to identify data requirements.

Skills

SQL

Dataform

Google Cloud Platform

BigQuery

Version control systems

Data security and compliance

Problem-solving

Collaboration

Education

Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field

Tools

Git

GitHub

GitLab

Job description

VTRAC Consulting Corporation
Intelligent Solutions

Thank you for applying to VTRAC opportunities. Please e-mail your resume as an MS-WORD document in confidence Subject: Dataform Engineer/Architect, Attention: [e-mail] or call: [phone].

Position #:25-00210

Position: Dataform Engineer/Architect

Position Type:6 months Contract
No. of Positions:1
Location: Toronto, Remote

Description
We are looking for a Dataform Architect to design and optimize data pipelines on Google Cloud Platform, leveraging Dataform and BigQuery. This role involves building reusable SQLX workflows, ensuring data quality and compliance, managing performance and costs, and collaborating with stakeholders to deliver scalable data solutions while mentoring junior team members.

Key Responsibilities:

• Design and develop data pipelines using Dataform and SQL on Google Cloud Platform (GCP).
• Implement reusable SQLX files for data transformation workflows and queries.
• Optimize and manage BigQuery environments for performance and cost-effectiveness.
• Collaborate with stakeholders to identify data requirements and develop data solutions.
• Maintain data integrity, security, and compliance through best practices and governance.
• Design and implement data quality checks and validation processes.
• Ensure version control and change management for data pipelines using tools such as Git.
• Develop and maintain documentation for data pipelines, including technical specifications and architecture diagrams.
• Stay up-to-date with industry trends and emerging technologies in data engineering and cloud computing.
• Mentor and provide guidance to junior team members on data pipeline development and best practices.

Qualifications:

• 5+ years of experience in data engineering, with a focus on SQL and cloud-based data platforms.
• Strong experience with Dataform and GCP, including BigQuery and other related services.
• Experience with version control systems such as Git, GitHub, or GitLab.
• Knowledge of data security, privacy, and compliance standards.
• Excellent communication, collaboration, and problem-solving skills.
• Experience with performance optimization and cost management in BigQuery.
• Familiarity with data governance and data quality best practices.
• Ability to work effectively in a fast-paced and dynamic environment.
• Passionate about staying current with emerging technologies and trends in data engineering and cloud computing.
• Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field.

We thank all candidates in advance. Only selected candidates for interviews will be contacted. For other exciting opportunities, please visit us atwww.vtrac.com. VTRAC is an equal-opportunity employer.

Toronto. Houston. New York. Palo Alto.