GCP Data Engineer

Astra-North Infoteck Inc.

Toronto

On-site

CAD 120,000 - 180,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Astra-North Infoteck Inc. in Toronto is seeking a Senior Data Engineer to design and optimize scalable data pipelines on Google Cloud Platform. You will work on end-to-end ELT/ETL processes, data lakes, and data warehouses to support enterprise-grade workloads.

You will leverage BigQuery, Dataflow, DataProc, Dataform, and Airflow for orchestration, with a focus on metadata, data quality, and governance. Collaboration with data scientists and product teams is essential for ML readiness.

Qualifications

  • 6–8 years of data engineering experience.
  • Deep expertise in Google Cloud Platform (GCP) and cloud-native architectures.
  • Hands-on experience with BigQuery, Dataflow, DataProc, Dataform, Cloud Composer, PySpark.
  • Strong understanding of ELT/ETL frameworks and data pipelines.

Responsibilities

  • Design end-to-end data architectures on GCP, including data lakes, data marts, and warehouse models.
  • Build scalable batch and streaming pipelines using Dataflow, DataProc, Dataform, and Pub/Sub.
  • Implement metadata, lineage, data quality and governance across pipelines.

Skills

Python
SQL
Java
Data modeling
ELT/ETL
Data warehousing
Streaming
Metadata governance

Tools

BigQuery
Dataflow
Dataproc
Dataform
Pub/Sub
Airflow
Terraform
Jenkins
GitLab CI
Git
Bitbucket
REST APIs
FastAPI

Job description

Job Description

Job Description: Experience Required: 6–8 years

Job Description

We are seeking a highly skilled Senior Data Engineer with deep expertise in Google Cloud Platform (GCP), distributed data processing, and cloud-native data architectures.

This role involves designing, building, optimizing, and maintaining scalable data pipelines and analytical platforms supporting enterprise‑grade workloads.

The ideal candidate brings strong hands‑on experience in BigQuery, Dataflow, DataProc, Dataform, Cloud Composer (Airflow), PySpark, and end‑to‑end ELT/ETL frameworks, along with robust knowledge of metadata, lineage, data quality, and CI/CD automation.

Key Responsibilities

Data Engineering & Architecture: Design and implement end‑to‑end data architectures on GCP, including data lakes, data marts, and warehouse models. Build scalable batch and streaming pipelines using Dataflow, DataProc (Spark), Dataform, and Pub/Sub. Architect low‑latency, high‑throughput processing solutions supporting advanced analytics and ML workloads. Develop pre‑aggregated models, materialized views, and optimized analytical structures in BigQuery.

ETL/ELT Pipeline Development: Design, develop, test, and optimize ELT/ETL pipelines for structured and unstructured data. Use Dataform and Cloud Composer (Airflow) for orchestration, dependency management, and metadata logging. Implement best practices for ingestion, transformation, storage, and data access patterns.

Data Quality, Metadata & Governance: Implement enterprise‑grade data quality checks using Great Expectations or custom Python frameworks. Manage metadata, lineage tracking, data cataloging, and compliance with governance standards. Ensure data integrity, schema enforcement, and security‑by‑design principles across all data pipelines.

Cloud Infrastructure & DevOps: Build and automate cloud infrastructure using Terraform, Jenkins, GitLab CI, and IaC best practices. Develop CI/CD workflows for pipeline deployments, testing gates, and operational automation. Monitor pipelines using Cloud Monitoring & Logging, optimizing for performance and cost.

Cross‑Functional Collaboration: Work closely with data scientists, analysts, platform engineering, and product owners to translate complex business needs into scalable data solutions. Support legacy‑to‑GCP migration initiatives, including Hadoop and on‑premise workloads. Enable advanced analytics and ML workloads through ML‑ready data pipelines.

Advanced Analytics & ML Support: Support feature engineering and ML data preparation for Vertex AI, Gemini, HuggingFace, or other ML platforms. Enable vector database workflows and generative AI data pipelines.

Required Technical Skills

Programming & Tools: Python, SQL, Java. Git, Bitbucket, Jenkins, GitLab CI. Terraform (IaC). REST APIs, FastAPI. Airflow DAG development.

Data Engineering Competencies: Data modeling (OLTP/OLAP). Data Warehousing. ELT/ETL pipelines. Streaming & real‑time processing. Data profiling and validation. Metadata, lineage, quality management.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Sr. GCP Data Engineer
Sr. GCP Data Engineer

Galent • Canada

On-site
CAD 120,000 - 150,000
GCP Cloud Architect
GCP Cloud Architect

Aarorn Technologies Inc • Toronto

Hybrid
CAD 68,880 - 89,544
Data Architect
Data Architect

Galent • Toronto

On-site
CAD 110,000 - 125,000
GCP Data Engineer
GCP Data Engineer

Aarorn Technologies Inc • Toronto

Hybrid
CAD 55,104 - 66,124
GCP Cloud Architect: Data & Spark ETL Lead
GCP Cloud Architect: Data & Spark ETL Lead

Aarorn Technologies Inc • Toronto

Hybrid
CAD 68,880 - 89,544
GCP Data Migration Engineer – PySpark & Salesforce Data Migration
GCP Data Migration Engineer – PySpark & Salesforce Data Migration

Astra-North Infoteck Inc. • Brampton

On-site
CAD 90,000 - 130,000
GCP Data Engineer: Spark, Python & BigQuery Expert
GCP Data Engineer: Spark, Python & BigQuery Expert

Aarorn Technologies Inc • Toronto

Hybrid
CAD 55,104 - 66,124
Data Architect
Data Architect

HRB • Toronto

On-site
CAD 120,000 - 160,000
Flexible vacation
3 weeks vacation
Health benefits with HSA/WSA
+2
GCP Cloud Architect/Engineer - BMO
GCP Cloud Architect/Engineer - BMO

Redpico • Toronto

Hybrid
CAD 120,000 - 160,000
Senior Big Data - Cloud Test Engineer -SQL, ETL, GCP, Pyspark
Senior Big Data - Cloud Test Engineer -SQL, ETL, GCP, Pyspark

Astra-North Infoteck Inc. • Toronto

On-site
CAD 75,000 - 95,000