Kafka Infrastructure Engineer — Remote & Flexible

AgileEngine, LLC.; Braga; Hybrid; EUR 98,000 - 133,000; Full time

Benefits offered by this job

Professional growth

Competitive compensation

Exciting projects

Flextime

Job summary

AgileEngine is seeking an Infrastructure Engineer (Kafka) to own and operate the Kafka estate behind an event-driven integration platform. You will design topics, partitioning, replication, and offsets, while ensuring resilience and replayability through a robust Kafka infra.

You will lead CI/CD pipelines, containerized deployments, and AI-assisted development practices, collaborating with a global team to maintain performance, cost efficiency, and regulatory readiness.

Qualifications

• Deep production Kafka experience (4+ years) with topic/partition design and consumer groups.
• Strong Linux engineering and Python scripting.
• Experience owning CI/CD pipelines and artifact release management.
• Hands-on with containers and OCI images (Docker/Podman).
• Experience with infrastructure-as-code and config management.
• Observability, metrics, alerting, and SLOs.
• Familiar with AI-assisted development in the workflow.
• Knowledge of TLS, secrets management, and OAuth2 security.
• Production operations mindset and cross-team communication.

Responsibilities

• Own the Kafka estate: topic design, partitioning, replication, and offsets.
• Ensure platform resilience and handle load without outages.
• Implement at-least-once and exactly-once semantics; dead-lettering and replay tooling.
• Build streaming observability: lag, throughput, dashboards, and alerts.
• Plan capacity, retention, and regulatory audit requirements.
• Evaluate vendor streaming and CDC mechanisms for ingress/egress.
• Own and evolve the build/release pipeline using Jenkins for enterprise Linux builds.
• Operate runtime estate: containers, gateway hosts, and OS modernization.
• Automate provisioning and maintain single source of truth for config/assets.
• Collaborate with Python developers on performance and cost.

Skills

Kafka 4+ yrs

Linux engineering

Python scripting

CI/CD pipelines

Jenkins pipelines

Containers Docker/Podman

OCI images

Observability tooling

AI coding with GenAI

Networking TLS

Tools

Kubernetes

Job description

AgileEngine is seeking an Infrastructure Engineer (Kafka) to own and operate the Kafka estate behind an event-driven integration platform. You will design topics, partitioning, replication, and offsets, while ensuring resilience and replayability through a robust Kafka infra.

You will lead CI/CD pipelines, containerized deployments, and AI-assisted development practices, collaborating with a global team to maintain performance, cost efficiency, and regulatory readiness.