Kafka Engineer

Your ITeams Sp. z o.o.; Poland; Hybrid; PLN 180,000 - 240,000; Full time

Benefits offered by this job

Luxmed Gold Extended medical care

Multisport Plus benefit

Job summary

Your ITeams Sp. z o.o. seeks an experienced Kafka Engineer to design, build and operate a hybrid Apache Kafka environment spanning on-premises and AWS.

You will work with Confluent Platform and Confluent Cloud to implement reliable replication, automated pipelines and observability across distributed systems. The role emphasizes hands-on engineering, automation and collaboration across infrastructure and development teams, with a strong focus on security, monitoring and incident response in an

Qualifications

• 4+ years hands-on Apache Kafka experience.
• Proven expertise with Confluent Platform (Enterprise) and Confluent Cloud.
• Experience with cluster migration and replication technologies like MirrorMaker 2, Cluster Linking, Confluent Replicator.
• Hands-on AWS experience (VPC, IAM, EC2, EKS, MSK, S3, KMS, Secrets Manager).
• Experience designing hybrid on-premises/AWS environments.
• Terraform proficiency including modules, Terratest or tfsec is a plus.
• Familiarity with CI/CD tools: GitHub Actions, GitLab CI or Jenkins.
• Scripting in Python, Bash, and Ansible.
• Strong security mindset for messaging platforms.
• Agile methodologies (Scrum/Kanban); Jira/Confluence knowledge.

Responsibilities

• Design, deploy and support Kafka-based solutions on AWS (MSK, EKS, Aurora).
• Implement data replication between on‑premises and AWS clusters using MirrorMaker 2, Cluster Linking, Replicator.
• Create and operate CI/CD pipelines and IaC to provision cloud Kafka infra.
• Lead cluster migrations and replication projects with data integrity and minimal disruption.
• Develop automation for Kafka integration tests and deployment validation.
• Monitor and observability setup with Prometheus, Grafana, Confluent Control Center, OpenTelemetry, Elastic Stack.
• Apply security best practices: TLS, SASL, ACLs, RBAC, encryption at rest/in transit.
• Collaborate with cross‑functional teams in Agile settings; contribute to runbooks and incident response.

Skills

Kafka

Automation

Python

Bash

Scripting

Agile

Tools

Confluent Platform

Confluent Cloud

Terraform

Terratest

tfsec

GitHub Actions

GitLab CI

Jenkins

AWS

MSK

EKS

S3

KMS

Secrets Manager

Prometheus

Grafana

Job description

We are seeking an experienced Kafka Engineer to design, build and operate a hybrid Apache Kafka environment spanning on-premises and AWS. The person in this role will work with Confluent Platform (Enterprise) and Confluent Cloud to implement reliable, secure replication, automated pipelines and observability across distributed systems. This role is ideal for someone who enjoys hands‑on engineering, automation, and collaboration across infrastructure and development teams.

Responsibilities

• Design, deploy and support Kafka-based solutions on AWS (including MSK, EKS, Aurora and related services).
• Implement and maintain data replication between on‑premises and AWS Kafka clusters using MirrorMaker 2, Cluster Linking and Confluent Replicator.
• Create and operate CI/CD pipelines and Infrastructure as Code (IaC) practices to provision and manage cloud Kafka infrastructure.
• Lead cluster migrations and replication projects, ensuring data integrity, performance and minimal disruption.
• Develop automation for Kafka integration tests and continuous validation of deployments.
• Implement and maintain monitoring and observability for Kafka and related services using tools such as Prometheus, Grafana, Confluent Control Center, OpenTelemetry and the Elastic Stack.
• Apply security best practices for Kafka and cloud services: TLS, SASL, ACLs, RBAC and encryption at rest and in transit.
• Collaborate with cross‑functional teams in Agile settings, contributing to design reviews, runbooks and incident response.

Qualifications

• Minimum 4 years of hands‑on experience with Apache Kafka.
• Strong expertise with Confluent Platform (Enterprise) and Confluent Cloud.
• Proven experience with cluster migration and replication technologies such as MirrorMaker 2, Cluster Linking and Confluent Replicator.
• Practical experience with AWS services including VPC, IAM, EC2, EKS, MSK, S3, KMS and Secrets Manager.
• Experience designing, implementing and maintaining hybrid environments (on‑premises AWS).
• Terraform experience preferred, including module development and testing (e.g., Terratest, tfsec).
• Familiarity with CI/CD platforms such as GitHub Actions, GitLab CI or Jenkins.
• Proficiency in scripting and automation with Python, Ansible and Bash.
• Hands‑on experience with monitoring and observability tooling as listed above.
• Strong understanding of security concepts relevant to messaging platforms.
• Experience working in Agile teams using Scrum and/or Kanban, and practical knowledge of Jira and Confluence.
• Unique TEAL culture, relationship- and respect-driven community, non‑corporate atmosphere.
• Agile approach and no bureaucracy.
• Outstanding integration trips to various places in Europe.
• Activities to support your well‑being and health.
• Luxmed Gold Extended medical care and Multisport Plus benefit.