Senior Platform Lead

Highbrow LLC; Toronto; Hybrid; CAD 100,000 - 120,000; Full time

Job summary

A technology company in Toronto is seeking a Senior Platform Lead to modernize and migrate their platform to cloud-native services. The ideal candidate will have over 10 years of experience in data engineering, with expertise in Cloudera and Linux, and strong scripting skills. This role involves defining technology roadmaps and collaborating with product teams to deliver business value. Candidates must have strong data governance capabilities and relevant cloud experience. Competitive benefits and a partially remote work model are offered.

Qualifications

• 10+ years of experience in data engineering and management.
• Strong grasp of fundamental concepts in networking and operational databases.
• Experience with data governance and cloud native services.

Responsibilities

• Define and execute a technology roadmap to modernize our platform.
• Collaborate with product owners to deliver business value.
• Innovate efficient data governance capabilities.

Skills

Cloudera/Hortonworks Hadoop

Linux (Redhat)

Azure Databricks

Data migration from HDFS to ADLS

Configuration management tools (Salt, Ansible)

Scripting (python/bash)

Version control system (Git/Bitbucket)

Job description

Senior Platform Lead

Job ID: 2024-12751

Job Location: Toronto, ON (2 days/week onsite)

Job Travel Location(s):

# Positions: 5

Employment Type: W2

Duration:Long Term

# of Layers:0

Work Eligibility:All Work Authorizations are Permitted – No Visa Transfers

Key Technology:Cloudera

Job Responsibilities:

• Defining and executing a best-in-class technology roadmap to modernize and migrate our platform to cloud native services
• Collaborating with our business product owners to define roadmaps that deliver incremental and well defined business value
• Enable, evolve, and innovate efficient data governance capabilities

Skills and Experience Required:

• Proficient operating Cloudera/Hortonworks Hadoop, HDFS/HBase/Yarn/Ranger/Spark/ZK, Ambari, Dremio, Druid, Airflow
• A strong grasp of fundamental concepts of Linux (Redhat), data engineering, network, warehouses, operational databases, messaging, and data management
• Good knowledge with Azure Databricks, Azure Data Factory, ADLS.
• Working knowledge of data migration from HDFS to ADLS usingADF.
• Experience with configuration management tools such as Salt, Ansible.
• Strong scripting skills with experience of platform automation using python/bash with version control system Git/Bitbucket
• 10+ years of experience.