Middleware Engineer (Kafka)

PM Consulting; Philippines; On-site; PHP 1,200,000 - 2,000,000; Full time

Job summary

PM Consulting is seeking a Kafka Cluster Administrator to deploy, configure, and operate production Kafka clusters, manage topics, ACLs, and related ecosystem tools in a cloud or on-prem setup.

You will optimize performance, build observability with Prometheus, Grafana, and the EFK stack, enforce security with TLS/SASL-SSL, participate in a 24/7 on-call rotation, and collaborate with engineering to onboard new producers/consumers while documenting the Event Catalog.

Qualifications

• Bachelor’s degree in Information Technology, Computer Science, or equivalent practical experience.
• 3+ years of hands-on professional experience administering Apache Kafka or enterprise event-streaming platforms in production.
• Confluent Certified Administrator for Apache Kafka (CCAAK) is a strong advantage.

Responsibilities

• Deploy, configure, and operate Apache Kafka production clusters, including broker tuning, topic management, and ACL administration.
• Administer key Kafka ecosystem tools, including Schema Registry, Kafka Connect, and MirrorMaker 2.
• Build and maintain automated provisioning, configuration, and deployment scripts using Infrastructure as Code (Terraform, Ansible).
• Drive root-cause resolution for platform incidents with minimal client impact and participate in a 24/7 on-call rotation for critical applications.
• Partner with engineering teams to onboard new producers and consumers, contributing to the Event Catalog and Subscription API documentation.

Skills

Linux/Unix Administration

Networking fundamentals

Event-driven architecture

On-call incident response

Education

Bachelor’s degree in Information Technology, Computer Science, or equivalent practical experience

Tools

Kafka

Schema Registry

Kafka Connect

MirrorMaker 2

Terraform

Ansible

Jenkins

Grafana

Prometheus

EFK stack

Job description

Key Responsibilities

Kafka Cluster Administration & Infrastructure

• Cluster Management: Deploy, configure, and operate Apache Kafka production clusters, including broker tuning, topic management, and ACL administration.
• Ecosystem Management: Administer key Kafka ecosystem tools, including Schema Registry, Kafka Connect, and MirrorMaker 2.
• Infrastructure Automation: Build and maintain automated provisioning, configuration, and deployment scripts using Infrastructure as Code (Terraform, Ansible).

Operations, Observability & Security

• Performance & Monitoring: Optimize cluster performance, conduct capacity planning, and maintain observability stacks (Prometheus, Grafana, EFK stack) for alerts and metrics.
• Security & Governance: Enforce data governance standards and configure Kafka security protocols, including TLS, SASL-SCRAM, and fine-grained access control lists (ACLs).
• Incident Management: Drive root-cause resolution for platform incidents with minimal client impact and participate in a 24/7 on-call rotation for critical applications.
• Developer Onboarding: Partner with engineering teams to onboard new producers and consumers, contributing to the Event Catalog and Subscription API documentation.

Requirements

Education & Experience

• Education: Bachelor’s degree in Information Technology, Computer Science, or equivalent practical experience.
• Platform Tenure: 3+ years of hands-on professional experience administering Apache Kafka or enterprise event-streaming platforms in production.
• Certifications (Preferred): Confluent Certified Administrator for Apache Kafka (CCAAK) is a strong advantage.

Technical Skills

• Kafka Ecosystem: Deep working knowledge of Kafka brokers, Schema Registry, Kafka Connect, MirrorMaker 2, and event-driven architecture patterns.
• DevOps & OS: Solid Linux/Unix system administration, networking fundamentals, and IaC tools (Terraform or Ansible).
• CI/CD & Monitoring: Experience with CI/CD tools (Jenkins, BitBucket, Rundeck) and centralized monitoring tools (Prometheus, Grafana, EFK).