Senior Software Consultant/Developer

Live Assets; Toronto; On-site; CAD 80,000 - 120,000; Full time

Job summary

An established industry player is seeking a Senior Software Consultant/Developer with a strong background in Google Cloud Platform and Big Data technologies. This exciting role involves hands-on development and optimization of data pipelines and cloud-based solutions, ensuring high performance and quality. Collaborating with stakeholders, you will support retail data initiatives and ensure timely delivery. If you have a passion for cloud technologies and data optimization, this is a fantastic opportunity to make a significant impact in a dynamic environment.

Qualifications

• 5+ years of hands-on experience with Google Cloud Platform (GCP).
• Proficiency in big data technologies and cloud services.

Responsibilities

• Develop and maintain scalable data pipelines on GCP.
• Optimize queries and big data jobs for performance.

Skills

Google Cloud Platform (GCP)

PySpark

Apache Airflow

BigQuery

DataProc

Cloud Storage

Job description

IT Jobs in Canada

Job Description

Live Assets | IT Staffing Solutions is hiring a Senior Software Consultant/Developer with strong expertise in Google Cloud Platform (GCP) and Big Data technologies to support our client. This role focuses on hands-on development, optimization, and deployment of data pipelines and cloud-based solutions.

Key Responsibilities

1. Develop, tune, and maintain scalable data pipelines on GCP.
2. Optimize queries and big data jobs for performance.
3. Collaborate with stakeholders to support retail data initiatives.
4. Ensure timely delivery and maintain high code quality.
5. Communicate effectively within the team and with client managers.

Necessary Skills

1. 5+ years of hands-on experience with GCP.
2. Proficiency in:
   • GCP services
   • PySpark
   • Apache Airflow (coding and tuning)
   • Pub/Sub
   • DataProc (deploying Spark jobs and tuning Spark performance)
   • BigQuery (including query optimization and working with BigTables)
   • Cloud Storage / GCS buckets

Nice to Have

1. Experience with Scala.
2. Knowledge of Druid.
3. Familiarity with Meta and YouTube Social APIs.