GCP Data Scientist - GCP, Pytho, Airflow

Astra North Infoteck Inc.; Ontario; On-site; CAD 90,000 - 120,000; Full time

Job summary

A leading data solutions company in Ontario is seeking a GCP Data Scientist to lead their team. The ideal candidate will have extensive experience in Data Engineering and cloud technologies, particularly in migrating Hadoop to Google Cloud. Responsibilities include developing data ingestion frameworks and collaborating with Data Engineers to optimize data pipelines. This role requires strong leadership skills and a deep understanding of big data technologies.

Qualifications

• 4-6 years of experience in data science tools and methodologies.
• Experience in managing Data Engineering teams and leading GCP projects.

Responsibilities

• Lead the GCP team and manage Data Engineering teams.
• Develop data ingestion frameworks and migrate Hadoop clusters to Google Cloud.

Skills

Leadership

Data Engineering

Collaboration

Education

Certified Professional Data Engineer - GCP

Tools

Python

PySpark

Hadoop

Google Cloud Platform

Job description

Keywords :

GCP Data Scientist, Airflow, Hive, SQL

Role Description :

1. Ability to lead the GCP team and extensive experience in managing and leading Data Engineering teams. Responsible and accountable for high-level and detailed technical design and solutions. Developing data ingestion frameworks for different sources. Strong migration experience of Hadoop clusters to Google Cloud.
2. Competencies: Digital: Big Data and Hadoop Ecosystem - MapR, Digital: Google Data Engineering.

Experience (Years) :

• 4-6 years of experience combining technical expertise, hands-on experience with data science tools and methodologies, familiarity with cloud technologies, and the ability to derive impactful insights from data. Ability to collaborate with Data Engineers and recommend pipeline modifications for staging strategies, focusing on pipeline performance, data models, and scheduler arrangements for data availability.
• Desirable Skills: Certified Professional Data Engineer - GCP is an advantage. Python & PySpark skills are also desirable.