Kafka Platform Engineer

Tata Consultancy Services Limited; Toronto; On-site; CAD 100,000 - 140,000; Full time

Job summary

Tata Consultancy Services Canada Inc. is seeking a Kafka Platform Engineer to install, configure, and manage Apache Kafka clusters across development, testing, UAT, and production environments.

You will handle brokers, topics, partitions, replication, and consumer groups to ensure stability and performance. You will monitor health and capacity using Prometheus, Grafana, Splunk, ELK, and Datadog, perform tuning and scaling, secure the cluster with SSL/TLS/SASL/ACLs, and drive HA/DR initiatives.

Qualifications

• Experience installing, configuring, and managing Apache Kafka clusters.
• Experience with Kafka security (SSL/TLS, SASL, ACLs).
• Strong Linux/Unix administration and scripting (Shell, Python).
• Ability to perform root cause analysis and incident management.

Responsibilities

• Install, configure, administer, and maintain Apache Kafka clusters across Development, Testing, UAT, and Production environments.
• Manage Kafka brokers, topics, partitions, replication factors, and consumergroups to ensure platform stability and performance.
• Monitor Kafka cluster health, availability, capacity, and resource utilization using enterprise monitoring tools.
• Perform Kafka performance tuning, capacity planning, and cluster scaling activities to support growing business workloads.
• Troubleshoot and resolve Kafka infrastructure, messaging, connectivity, and performance-related issues.
• Configure and manage Kafka security controls including SSL/TLS, SASL authentication, ACLs, and encryption standards.
• Support Kafka Connect, Schema Registry, and other ecosystem components required for data integration.
• Implement and maintain High Availability (HA) and Disaster Recovery (DR) solutions for Kafka platforms.
• Perform Kafka upgrades, patching, migration, and platform maintenance activities with minimal business impact.
• Collaborate with application, data engineering, infrastructure, and DevOps teams to onboard and support Kafka-based applications.
• Develop and maintain operational procedures, runbooks, architecturedocumentation, and support guides.
• Configure and manage monitoring, logging, alerting, and incident management processes for Kafka environments.
• Support production deployments, release activities, and environment readiness assessments.
• Perform root cause analysis for production incidents and implement preventive measures to improve platform reliability.
• Automate administrative and operational tasks using Shell scripting, Python, or other automation tools.
• Ensure platform compliance with organizational security, governance, audit, and regulatory requirements.
• Participate in on-call support and provide timely resolution for critical production issues.
• Drive continuous improvement initiatives to enhance Kafka platform performance, scalability, security, and operational efficiency.

Skills

Apache Kafka

Linux

Shell scripting

Python

Prometheus

Grafana

Splunk

ELK

Datadog

Bash scripting

Kubernetes

ZooKeeper

High Availability

Tools

Kafka

Kafka Connect

Schema Registry

Prometheus

Grafana

Splunk

ELK

Datadog

Shell scripting

Python

Linux/Unix

Bash

Job description

Tata Consultancy Services Canada Inc. is seeking a Kafka Platform Engineer to install, configure, and manage Apache Kafka clusters across development, testing, UAT, and production environments.

You will handle brokers, topics, partitions, replication, and consumer groups to ensure stability and performance. You will monitor health and capacity using Prometheus, Grafana, Splunk, ELK, and Datadog, perform tuning and scaling, secure the cluster with SSL/TLS/SASL/ACLs, and drive HA/DR initiatives.