Senior Platform Lead – Data Pipeline & Big Data Architect

Highbrow LLC; Toronto; Hybrid; CAD 120,000 - 150,000; Full time

Job summary

A leading technology solutions provider is seeking a Sr Platform Lead – Full Stack to create and maintain optimal data pipeline architecture in a hybrid environment. The ideal candidate has over 10 years of relevant experience, expert knowledge of big data tools like Hadoop and Spark, as well as strong skills in Java and Spring. The role requires strong capabilities in data quality assurance and microservices design. Join a team focused on enhancing data solutions for impactful results!

Qualifications

• 10+ years of relevant experience in a related field.
• Experience designing production grade, scalable applications and microservices.
• 5+ years of Capital Markets experience.

Responsibilities

• Create and maintain optimal data pipeline architecture.
• Implement data products curated by our Chief Data Office.
• Ensure data quality and integrity across various data sources.
• Optimize data pipelines for performance and scalability.
• Provide technical support to resolve escalated incidents.
• Conduct code reviews to ensure quality and standards compliance.

Skills

Java

Spring

Hadoop

HDFS

ADLS

ADF

Spark

Kafka

Databricks

Dremio

Cassandra

Python

Scala

Job description

A leading technology solutions provider is seeking a Sr Platform Lead – Full Stack to create and maintain optimal data pipeline architecture in a hybrid environment. The ideal candidate has over 10 years of relevant experience, expert knowledge of big data tools like Hadoop and Spark, as well as strong skills in Java and Spring. The role requires strong capabilities in data quality assurance and microservices design. Join a team focused on enhancing data solutions for impactful results!