GCP Data Engineer: Spark, Python & BigQuery Expert

Aarorn Technologies Inc; Toronto; Hybrid; CAD 55,104 - 66,124; Full time

Job summary

A leading IT services company is seeking a skilled GCP Data Engineer to design, develop, and maintain data pipelines on Google Cloud Platform. The ideal candidate will have expertise in Spark Serverless, ETL design, and Python programming. This mid-senior level contract position requires strong knowledge of data governance and GCP services like BigQuery and CloudSQL. The role is on-site three times a week in Toronto and offers a pay range of CAD$40 to CAD$48 per hour.

Qualifications

• Deep knowledge of GCP services and data governance.
• Experience in building and optimizing data workflows.
• Proficiency in ETL workflow design using Spark and Python.

Responsibilities

• Design and maintain scalable ETL workflows using Spark and Python.
• Implement data ingestion and loading processes.
• Utilize GCP services for efficient data processing.
• Optimize performance and cost for data workflows.
• Ensure compliance with regulatory standards.

Skills

Google Cloud Platform

Spark Serverless

Python programming

BigQuery

CloudSQL

Data governance

Data quality frameworks

Cloud Logging

Cloud Monitoring

Education

GCP Professional Data Engineer certification

Tools

Docker

Kubernetes

Job description

A leading IT services company is seeking a skilled GCP Data Engineer to design, develop, and maintain data pipelines on Google Cloud Platform. The ideal candidate will have expertise in Spark Serverless, ETL design, and Python programming. This mid-senior level contract position requires strong knowledge of data governance and GCP services like BigQuery and CloudSQL. The role is on-site three times a week in Toronto and offers a pay range of CAD$40 to CAD$48 per hour.