Kafka Admin

Pacer Group; Toronto; On-site; CAD 90,000 - 130,000; Full time

Job summary

Pacer Group is seeking a Kafka Platform Engineer to install, configure, and maintain Apache Kafka clusters across Development, UAT, and Production environments. You will manage brokers, topics, partitions, replication, consumer groups, and Schema Registry to ensure reliability.

Responsibilities include performance tuning, HA/DR, security with SSL/TLS and SASL, and monitoring with Prometheus, Grafana, Splunk, ELK, or Datadog.

Qualifications

• Experience installing and operating Apache Kafka clusters.
• Strong knowledge of Kafka security (SSL/TLS, SASL, ACLs).
• Experience with monitoring tools such as Prometheus, Grafana, Splunk, ELK, or Datadog.

Responsibilities

• Install, configure, administer, and maintain Apache Kafka clusters across Development, UAT, and Production environments.
• Manage Kafka brokers, topics, partitions, replication, consumer groups, Kafka Connect, and Schema Registry.
• Perform Kafka performance tuning, capacity planning, cluster scaling, and HA/DR implementation.
• Configure and manage Kafka security using SSL/TLS, SASL, ACLs, and encryption.
• Monitor Kafka environments using Prometheus, Grafana, Splunk, ELK, or Datadog and troubleshoot production issues.
• Perform Kafka upgrades, patching, migrations, production support, and RCA.
• Automate operational tasks using Linux/Unix, Shell (Bash), and Python scripting.
• Collaborate with DevOps, Infrastructure, Data Engineering, and Application teams to support Kafka-based solutions.
• Strong understanding of distributed systems, event-driven architecture, incident management, and platform reliability.

Skills

Apache Kafka

Kafka security

Monitoring tools

Automation scripting

DevOps collaboration

Tools

Prometheus

Grafana

Splunk

ELK

Datadog

Job description

• Install, configure, administer, and maintain Apache Kafka clusters across Development, UAT, and Production environments.
• Manage Kafka brokers, topics, partitions, replication, consumer groups, Kafka Connect, and Schema Registry.
• Perform Kafka performance tuning, capacity planning, cluster scaling, and high availability (HA/DR) implementation.
• Configure and manage Kafka security using SSL/TLS, SASL, ACLs, and encryption.
• Monitor Kafka environments using Prometheus, Grafana, Splunk, ELK, or Datadog and troubleshoot production issues.
• Perform Kafka upgrades, patching, migrations, production support, and root cause analysis (RCA).
• Automate operational tasks using Linux/Unix, Shell (Bash), and Python scripting.
• Collaborate with DevOps, Infrastructure, Data Engineering, and Application teams to support Kafka-based solutions.
• Strong understanding of distributed systems, event-driven architecture, incident management, and platform reliability.

EEOC Compliance:

We are an equal opportunity employer, and all qualified applicants will receive consideration for employment.