Senior Kafka & Flink Architect — Real-Time Streaming

HCLTech; Canada; On-site; CAD 90,000 - 120,000; Full time

Job summary

A leading tech company in Canada is seeking a skilled Architect to assist in building out their Kafka platform with a focus on Flink. This role requires significant experience in high-volume, low-latency stream processing, advanced proficiency in Flink and Kafka, and a strong background in governance and CI/CD practices. The ideal candidate will lead a development team, contribute to solutions design, and provide hands-on production support for critical streaming platforms, particularly in the Retail Industry.

Qualifications

• Expert-level architecture and implementation experience with Flink applications.
• Extensive experience in production environments with Confluent Cloud Kafka.
• Strong background in cost optimization and resource monitoring.

Responsibilities

• Assist in building out the Kafka platform with a focus on Flink.
• Contribute to design and evaluation of solutions.
• Lead development team and provide hands-on production support.

Skills

Expert-level architecture and implementation experience of Flink applications

Extensive experience with Confluent Cloud Kafka and Flink

Advanced proficiency in Flink concepts including state management

Knowledge of Event Time processing and Windowing

Advanced knowledge of KSQL DB and KStreams

Proficiency in Kafka Connectors

Experience in the Retail Industry with Flink and Kafka

Background in platform governance

Expertise with Terraform and IaC

Experience with CI/CD for Flink jobs

Advanced knowledge of GCP networking

Experience with cloud-native monitoring solutions

Experience with Disaster Recovery and High Availability strategies

Familiarity with cost optimization for Flink and Kafka

Experience with schema management and data governance

Capability in capacity planning and scaling

Experience in Agile/DevOps methodologies

Job description

A leading tech company in Canada is seeking a skilled Architect to assist in building out their Kafka platform with a focus on Flink. This role requires significant experience in high-volume, low-latency stream processing, advanced proficiency in Flink and Kafka, and a strong background in governance and CI/CD practices. The ideal candidate will lead a development team, contribute to solutions design, and provide hands-on production support for critical streaming platforms, particularly in the Retail Industry.