Senior DevOps Consultant (Kafka)

Consult; Kraków; Hybrid; PLN 186,000 - 234,000; Full time

Job summary

Consult is seeking a Kafka/DevOps engineer to own the management and operational excellence of Kafka clusters running on Kubernetes. You will ensure stability, scalability and observability across the Kafka ecosystem while driving automation and process improvements.

You will deploy and operate Kafka components, manage topics and connectors, and lead incident analysis with a focus on reliability. Hybrid work from Kraków is expected, 6 days a month.

Qualifications

• Extensive hands-on Kafka experience with Apache and Confluent platforms.
• Experience administrating end-to-end Kafka platforms and topics.
• Strong Kubernetes operational skills for deploying and managing Kafka on Kubernetes.

Responsibilities

• Manage Kafka clusters and ensure platform stability, scalability and observability.
• Deploy, scale, upgrade and troubleshoot Kafka components on Kubernetes.
• Administer and operate the Kafka platform end-to-end, including topics and bindings.

Skills

Apache Kafka

Confluent Kafka

Kubernetes

Kafka Connect

Schema Registry

ZooKeeper/KRaft

Monitoring

Prometheus

Grafana

Splunk

Automation scripting

Performance tuning

Tools

Docker

Jenkins

GitHub

JIRA

Confluence

Job description

Type of contract: B2B contract

Salary range: 135 - 170 PLN/H

What will you do?

You will be responsible for the management and operational excellence of Kafka clusters running in a Kubernetes environment. You will work across the Kafka ecosystem, ensuring platform stability, scalability, performance and observability while supporting the automation and continuous improvement of operational processes.

Your tasks

• Provide deep technical expertise across the Kafka ecosystem, including brokers, ZooKeeper/KRaft, Kafka Connect and Schema Registry


• Deploy and operate Kafka components on Kubernetes, including scaling, upgrades, configuration and troubleshooting


• Administer and operate the Kafka platform end-to-end


• Provision and manage Kafka Topics and Role-bindings


• Configure, deploy and maintain Kafka connectors, including MQ, Splunk, MongoDB and GCP Pub/Sub


• Manage Kafka Connect components, including workers, tasks, converters and SMTs


• Implement monitoring and alerting to ensure platform observability and resilience


• Automate operational and maintenance activities using scripting and automation tools


• Perform benchmarking, performance analysis and tuning to ensure scalable and efficient data streaming


• Lead root cause analysis for production incidents


• Document incident findings and implement preventative improvements to increase platform reliability

Requirements

• Strong hands-on experience with Apache Kafka and Confluent Kafka


• Strong knowledge of Kafka brokers, ZooKeeper/KRaft, Kafka Connect and Schema Registry


• Hands-on experience with Kubernetes


• Experience in end-to-end Kafka platform administration and operations


• Experience with Kafka Topics and Role-bindings


• Experience configuring and maintaining Kafka connectors


• Knowledge of Kafka Connect workers, tasks, converters and SMTs


• Experience with monitoring and observability tools such as Prometheus, Grafana and Splunk


• Experience with scripting and automation of operational activities


• Experience with Kafka performance analysis, benchmarking and tuning


• Strong troubleshooting and root cause analysis skills in production environments


• Openness to work hybrid from our client's office (Kraków) 6 days a month

Nice to have

• Experience with MQ integrations


• Experience with MongoDB integrations


• Experience with GCP Pub/Sub integrations


• Experience with DevOps tools such as GitHub, Jenkins, JIRA and Confluence