Senior GCP Data Engineer — Scalable ETL/Streaming

Tata Consultancy Services Limited; Toronto; On-site; CAD 110,000 - 150,000; Full time

Job summary

Tata Consultancy Services Canada Inc. is seeking an experienced GCP Data Engineer with 8-10 years of expertise in designing, developing, and optimizing large-scale data platforms and cloud-native data solutions.

Strong hands‑on experience in PySpark, Python, BigQuery, Dataproc, Kafka, Airflow, SQL, and GCP services, with proven success in building scalable ETL/ELT pipelines, batch and real-time data processing frameworks, and enterprise data warehouse solutions.

Qualifications

• 8-10 years of experience in designing, developing and optimizing large-scale data platforms on cloud
• Hands-on with PySpark, Python, BigQuery, Dataproc, Kafka, Airflow, SQL and GCP services
• Experience building scalable ETL/ELT pipelines and real-time data processing frameworks

Responsibilities

• Design and develop scalable ETL/ELT pipelines using PySpark, Python, and Spark SQL.
• Build and optimize data processing solutions on GCP using Dataproc, BigQuery, and GCS.
• Develop and maintain Kafka-based streaming pipelines for real-time ingestion and processing.
• Create and manage BigQuery datasets, tables, views, and complex queries.
• Implement workflow orchestration with Cloud Composer (Airflow).
• Manage cloud security through IAM roles and access policies.
• Collaborate with Data Architects, DevOps, Data Scientists and stakeholders.
• Provide production support, troubleshooting and performance optimization.

Skills

PySpark

Python

BigQuery

Dataproc

Kafka

Airflow

SQL

GCP services

Tools

Git

CI/CD

Terraform

Shell scripting

Cloud Composer

Job description

Tata Consultancy Services Canada Inc. is seeking an experienced GCP Data Engineer with 8-10 years of expertise in designing, developing, and optimizing large-scale data platforms and cloud-native data solutions.

Strong hands‑on experience in PySpark, Python, BigQuery, Dataproc, Kafka, Airflow, SQL, and GCP services, with proven success in building scalable ETL/ELT pipelines, batch and real-time data processing frameworks, and enterprise data warehouse solutions.