Kafka Admin

Tata Consultancy Services Limited; Toronto; On-site; CAD 100,000 - 140,000; Full time

Job summary

Tata Consultancy Services Canada Inc. is seeking a Kafka Platform Engineer to install, configure, and manage Apache Kafka clusters across development, testing, UAT, and production environments.

You will handle brokers, topics, partitions, replication, and consumer groups to ensure stability and performance. You will monitor health and capacity using Prometheus, Grafana, Splunk, ELK, and Datadog, perform tuning and scaling, secure the cluster with SSL/TLS/SASL/ACLs, and drive HA/DR initiatives.

Qualifications

• Experience installing, configuring, and managing Apache Kafka clusters.
• Experience with Kafka security (SSL/TLS, SASL, ACLs).
• Strong Linux/Unix administration and scripting (Shell, Python).
• Ability to perform root cause analysis and incident management.

Responsibilities

• Install, configure, administer, and maintain Apache Kafka clusters across Development, Testing, UAT, and Production environments.
• Manage Kafka brokers, topics, partitions, replication factors, and consumergroups to ensure platform stability and performance.
• Monitor Kafka cluster health, availability, capacity, and resource utilization using enterprise monitoring tools.
• Perform Kafka performance tuning, capacity planning, and cluster scaling activities to support growing business workloads.
• Troubleshoot and resolve Kafka infrastructure, messaging, connectivity, and performance-related issues.
• Configure and manage Kafka security controls including SSL/TLS, SASL authentication, ACLs, and encryption standards.
• Support Kafka Connect, Schema Registry, and other ecosystem components required for data integration.
• Implement and maintain High Availability (HA) and Disaster Recovery (DR) solutions for Kafka platforms.
• Perform Kafka upgrades, patching, migration, and platform maintenance activities with minimal business impact.
• Collaborate with application, data engineering, infrastructure, and DevOps teams to onboard and support Kafka-based applications.
• Develop and maintain operational procedures, runbooks, architecturedocumentation, and support guides.
• Configure and manage monitoring, logging, alerting, and incident management processes for Kafka environments.
• Support production deployments, release activities, and environment readiness assessments.
• Perform root cause analysis for production incidents and implement preventive measures to improve platform reliability.
• Automate administrative and operational tasks using Shell scripting, Python, or other automation tools.
• Ensure platform compliance with organizational security, governance, audit, and regulatory requirements.
• Participate in on-call support and provide timely resolution for critical production issues.
• Drive continuous improvement initiatives to enhance Kafka platform performance, scalability, security, and operational efficiency.

Skills

Apache Kafka

Linux

Shell scripting

Python

Prometheus

Grafana

Splunk

ELK

Datadog

Bash scripting

Kubernetes

ZooKeeper

High Availability

Tools

Kafka

Kafka Connect

Schema Registry

Prometheus

Grafana

Splunk

ELK

Datadog

Shell scripting

Python

Linux/Unix

Bash

Job description

Tata Consultancy Services (TCS) is an equal opportunity employer, andembraces diversity in race, nationality, ethnicity, gender, age, physicalability, neurodiversity, and sexual orientation, to create a workforce thatreflects the societies we operate in. Our continued commitment to Culture andDiversity is reflected in our people stories across our workforce and implementedthrough equitable workplace policies and processes.

Tata Consultancy Services (BSE: 532540, NSE: TCS) is thetechnology partner of choice for industry-leading organizations worldwide.Since its inception in 1968, TCS has upheld the highest standards ofinnovation, engineering excellence and customer service.

It has set an aspiration to become the world's largestAI-led technology services company and is enabling its clients to transformthemselves across the full AI stack, from infrastructure to intelligence.

Rooted in the heritage of the Tata Group, TCS is focused oncreating long term value for its clients, its investors, its employees, and thecommunity at large. With a highly skilled workforce spread across 56 countriesand 194 service delivery centers across the world, the company has beenrecognized as a top employer on six continents. With the ability to rapidlyapply and scale new technologies, the company has built long term partnershipswith its clients. Many of these relationships have endured into decades andnavigated every technology cycle, from mainframes in the 1970s to artificialintelligence today.

Role Description

• Kafka Cluster Installation, Configuration, and Management
• Topic, Partition, and Replication Management
• Kafka Broker Administration and Performance Tuning
• Kafka Connect
• Schema Registry
• Consumer Group Management
• Kafka Security (SSL/TLS, SASL, ACLs)
• High Availability and Disaster Recovery Configuration
• Kafka Monitoring and Alerting
• Linux/Unix Administration
• Shell Scripting (Bash) and/or Python Scripting
• Troubleshooting and Root Cause Analysis of Kafka Production Issues
• Capacity Planning and Cluster Scaling
• Log Analysis and Performance Optimization
• Experience with Monitoring Tools (Prometheus, Grafana, Splunk, ELK, Datadog)
• Understanding of Distributed Systems and Event-Driven Architecture
• Production Support and Incident Management
• Kafka Upgrades, Patching, and Maintenance Activities

Roles & Responsibilities

• Install, configure, administer, and maintain Apache Kafka clusters across Development, Testing, UAT, and Production environments.
• Manage Kafka brokers, topics, partitions, replication factors, and consumergroups to ensure platform stability and performance.
• Monitor Kafka cluster health, availability, capacity, and resourceutilization using enterprise monitoring tools.
• Perform Kafka performance tuning, capacity planning, and cluster scalingactivities to support growing business workloads.
• Troubleshoot and resolve Kafka infrastructure, messaging, connectivity, andperformance-related issues.
• Configure and manage Kafka security controls including SSL/TLS, SASLauthentication, ACLs, and encryption standards.
• Support Kafka Connect, Schema Registry, and other ecosystem componentsrequired for data integration.
• Implement and maintain High Availability (HA) and Disaster Recovery (DR)solutions for Kafka platforms.
• Perform Kafka upgrades, patching, migration, and platform maintenance activitieswith minimal business impact.
• Collaborate with application, data engineering, infrastructure, and DevOpsteams to onboard and support Kafka-based applications.
• Develop and maintain operational procedures, runbooks, architecturedocumentation, and support guides.
• Configure and manage monitoring, logging, alerting, and incident managementprocesses for Kafka environments.
• Support production deployments, release activities, and environment readinessassessments.
• Perform root cause analysis for production incidents and implement preventivemeasures to improve platform reliability.
• Automate administrative and operational tasks using Shell scripting, Python,or other automation tools.
• Ensure platform compliance with organizational security, governance, audit,and regulatory requirements.
• Participate in on-call support and provide timely resolution for criticalproduction issues.
• Drive continuous improvement initiatives to enhance Kafka platform performance,scalability, security, and operational efficiency.

Tata Consultancy Services Canada Inc. iscommitted to meeting the accessibility needs of all individuals in accordancewith the Accessibility for Ontarians with Disabilities Act (AODA) and theOntario Human Rights Code (OHRC). Should you require accommodation during therecruitment and selection process, please inform Human Resources.