Kafka Engineer

Mindbox Sp. z o.o.; Wrocław; Hybrid; PLN 180,000 - 280,000; Full time

Benefits offered by this job

Flexible cooperation model

Hybrid work setup

InterPolska Health Care

Job summary

Mindbox Sp. z o.o. poszukuje doświadczonego inżyniera Kafka z dogłębną wiedzą o Confluent Platform i Confluent Cloud, odpowiedzialnego za budowanie hybrydowego środowiska łączącego on-prem z chmurą AWS.

Zakres obejmuje projektowanie topologii, konfigurację komponentów Confluent, migracje klastrów i implementację observability. Praca hybrydowa, elastyczne modele współpracy oraz rozwój zawodowy w zespole ekspertów.

Qualifications

• Minimum 4 lata doświadczenia z Apache Kafka.
• Doświadczenie z Confluent Platform i Confluent Cloud.
• Praktyczna migracja klastrów i replikacja (MirrorMaker 2, Cluster Linking, Replicator).
• Znajomość AWS: VPC, IAM, EC2, EKS, MSK, S3, KMS, Secrets Manager.
• Umiejętność Terraform i Ansible.
• Doświadczenie CI/CD (GitHub Actions, GitLab CI, Jenkins).
• Programowanie Python/Bash.
• Monitorowanie (Prometheus, Grafana, OpenTelemetry, ELK).
• Bezpieczeństwo: TLS, SASL, ACL, RBAC, szyfrowanie w tranzycie i w spoczynku.
• Zwinne metodyki (Scrum/Kanban), Jira/Confluence.

Responsibilities

• Projektowanie topologii hybrydowych Kafka (on-prem, AWS).
• Konfiguracja komponentów Confluent (Schema Registry, Flink, Control Center, Tableflow).
• Wdrażanie klastrów Kafka w AWS MSK i Confluent Cloud.
• Implementacja observability (Prometheus, Grafana, Control Center).
• Konfiguracja MirrorMaker 2, Cluster Linking i Replicator.
• Definiowanie pipeline'ów dla zadań Kafka (CI/CD, deploy schem).
• IaC z Terraform, moduły, Terratests, tfsec, automated apply.
• Automatyzacja testów integracyjnych dla rozwiązań Kafka.
• Tworzenie runbooks, alertów, SLA/SLO dla hybrydowej architektury.
• Diagnozowanie problemów wydajności i optymalizacje konfiguracji.
• Współpraca z Data Platform, mentorskie wsparcie zespołów.

Skills

Kafka

Confluent Platform

Confluent Cloud

MirrorMaker 2

Cluster Linking

Replicator

AWS

Terraform

Ansible

CI/CD

Python

Bash

Prometheus

Grafana

OpenTelemetry

ELK

TLS

SASL

ACL

RBAC

Scrum

Kanban

Jira

Confluence

Tools

Terraform

Ansible

GitHub Actions

GitLab CI

Jenkins

Prometheus

Grafana

OpenTelemetry

Control Center

Kafka Connect

Job description

Nasze wymagania:

• Minimum 4 years of experience with Apache Kafka
• Proven expertise with Confluent Platform (Enterprise) and Confluent Cloud
• Hands-on experience in cluster migration and replication (MirrorMaker 2, Cluster Linking, Replicator)
• Strong AWS knowledge: VPC, IAM, EC2, EKS, MSK, S3, KMS, Secrets Manager
• Proficiency in Terraform (modules, linting, testing) and Ansible
• Experience with CI/CD pipelines (GitHub Actions, GitLab CI, Jenkins)
• Strong programming/scripting skills: Python, Ansible, Bash
• Monitoring with Prometheus/Grafana, Confluent Control Center, OpenTelemetry, ELK stack
• Security expertise: TLS, SASL, ACL, RBAC, encryption in transit & at rest
• Agile delivery experience (Scrum/Kanban), familiarity with Jira/Confluence

Mile widziane:

• AWS, Confluent, or Terraform certifications
• Experience automating integration and performance tests for Kafka
• Exposure to streaming ecosystem tools (Apache Flink, Kafka Connect at scale)

O projekcie:

We are looking for an experienced Kafka Engineer with in-depth knowledge of Confluent Platform and Confluent Cloud to play a key role in building a hybrid Kafka environment connecting on-prem clusters with AWS cloud.

Sounds like your kind of challenge?

Zakres obowiązków:

• Design hybrid Kafka topologies (on-prem AWS)
• Select and configure Confluent Platform components (Schema Registry, Flink, Control Center, Tableflow)
• Deploy and configure Kafka clusters in AWS MSK and Confluent Cloud
• Implement observability solutions (Prometheus, Grafana, Control Center)
• Configure MirrorMaker 2, Cluster Linking, and Confluent Replicator
• Ensure low-latency, high-consistency data transfers across environments
• Define pipelines (GitHub Actions, GitLab CI, Jenkins) for Kafka workloads, schema deployments, and consumer apps
• Implement IaC with Terraform, including module development, testing (terratest, tfsec), and automated apply
• Automate integration tests for Kafka-based solutions
• Develop runbooks, alerts, SLAs/SLOs for hybrid Kafka estate
• Troubleshoot performance bottlenecks and optimize configurations
• Work with cross-functional Data Platform Teams (Data Engineering, DevOps, Security)
• Mentor junior engineers and conduct technical knowledge-sharing sessions
• Note: Detailed project information will be shared during the recruitment process.

Oferujemy:

• Flexible cooperation model
• Hybrid work setup - remote days available depending on the client's arrangements - 1 day a month from the office in Wrocław
• Collaborative team culture - work alongside experienced professionals eager to share knowledge
• Continuous development - access to training platforms and growth opportunities
• Comprehensive benefits - including Interpolska Health Care, Multisport card, Warta Insurance, and more
• High quality equipment - laptop and essential software provided