Kafka Admin

Tata Consultancy Services; Toronto; On-site; CAD 90,000 - 120,000; Full time

Job summary

Tata Consultancy Services in Toronto, Canada, seeks an experienced Kafka specialist to install, configure, and administer large Kafka clusters across development, testing, UAT and production environments.

You will manage topics, partitions, replication, consumer groups, and security (SSL/TLS, SASL, ACLs), optimize performance, monitor health with enterprise tools, and lead capacity planning, scaling, and incident resolution.

Qualifications

• Experience installing, configuring, and maintaining Apache Kafka clusters across multiple environments.
• Strong knowledge of topics, partitions, replication factors, and consumer groups.
• Proficiency in Kafka security (SSL/TLS, SASL, ACLs) and access controls.
• Scripting skills in Bash or Python for automation and monitoring tasks.
• Hands-on experience with enterprise monitoring tools and incident response.

Responsibilities

• Install, configure, administer, and maintain Kafka clusters across Development, Testing, UAT, and Production.
• Manage brokers, topics, partitions, replication factors, and consumer groups for stability.
• Monitor cluster health, capacity, and resource utilization using Prometheus, Grafana, Splunk, or Datadog.
• Perform performance tuning, capacity planning, and scaling to support growing workloads.
• Troubleshoot and resolve Kafka infrastructure, messaging, connectivity, and performance issues.

Skills

Kafka Administration

Security & Compliance

Monitoring & Troubleshooting

Scripting (Bash/Python)

Capacity Planning & Scaling

Performance Tuning

Log Analysis

Cluster Management

Tools

Kafka Connect

Schema Registry

Prometheus

Grafana

Splunk

ELK Stack

Datadog

Job description

- Kafka Cluster Installation, Configuration, and Management

- Topic, Partition, and Replication Management

- Kafka Broker Administration and Performance Tuning

- Kafka Connect

- Schema Registry

- Consumer Group Management

- Kafka Security (SSL/TLS, SASL, ACLs)

- High Availability and Disaster Recovery Configuration

- Kafka Monitoring and Alerting

- Shell Scripting (Bash) and/or Python Scripting

- Troubleshooting and Root Cause Analysis of Kafka Production Issues

- Capacity Planning and Cluster Scaling

- Log Analysis and Performance Optimization

- Experience with Monitoring Tools (Prometheus, Grafana, Splunk, ELK, Datadog)

- Install, configure, administer, and maintain Apache Kafka clusters across Development, Testing, UAT, and Production environments.

- Manage Kafka brokers, topics, partitions, replication factors, and consumer groups to ensure platform stability and performance.

- Monitor Kafka cluster health, availability, capacity, and resource utilization using enterprise monitoring tools.

- Perform Kafka performance tuning, capacity planning, and cluster scaling activities to support growing business workloads.

- Troubleshoot and resolve Kafka infrastructure, messaging, connectivity, and performance-related issues.