Kafka Platform Engineer: Cluster, Security & Performance

Tata Consultancy Services; Toronto; On-site; CAD 90,000 - 120,000; Full time

Job summary

Tata Consultancy Services in Toronto, Canada, seeks an experienced Kafka specialist to install, configure, and administer large Kafka clusters across development, testing, UAT and production environments.

You will manage topics, partitions, replication, consumer groups, and security (SSL/TLS, SASL, ACLs), optimize performance, monitor health with enterprise tools, and lead capacity planning, scaling, and incident resolution.

Qualifications

• Experience installing, configuring, and maintaining Apache Kafka clusters across multiple environments.
• Strong knowledge of topics, partitions, replication factors, and consumer groups.
• Proficiency in Kafka security (SSL/TLS, SASL, ACLs) and access controls.
• Scripting skills in Bash or Python for automation and monitoring tasks.
• Hands-on experience with enterprise monitoring tools and incident response.

Responsibilities

• Install, configure, administer, and maintain Kafka clusters across Development, Testing, UAT, and Production.
• Manage brokers, topics, partitions, replication factors, and consumer groups for stability.
• Monitor cluster health, capacity, and resource utilization using Prometheus, Grafana, Splunk, or Datadog.
• Perform performance tuning, capacity planning, and scaling to support growing workloads.
• Troubleshoot and resolve Kafka infrastructure, messaging, connectivity, and performance issues.

Skills

Kafka Administration

Security & Compliance

Monitoring & Troubleshooting

Scripting (Bash/Python)

Capacity Planning & Scaling

Performance Tuning

Log Analysis

Cluster Management

Tools

Kafka Connect

Schema Registry

Prometheus

Grafana

Splunk

ELK Stack

Datadog

Job description

Tata Consultancy Services in Toronto, Canada, seeks an experienced Kafka specialist to install, configure, and administer large Kafka clusters across development, testing, UAT and production environments.

You will manage topics, partitions, replication, consumer groups, and security (SSL/TLS, SASL, ACLs), optimize performance, monitor health with enterprise tools, and lead capacity planning, scaling, and incident resolution.