Kafka Infrastructure Engineer — Remote & Flexible Schedule

AgileEngine, LLC.; La Coruña; Hybrid; EUR 107,000 - 160,000; Full time

Benefits offered by this job

Professional growth

Competitive compensation

Exciting projects

Flextime

Job summary

AgileEngine is seeking an Infrastructure Engineer (Kafka) to own and operate the Kafka estate behind an event-driven integration platform, including its build, deployment, and monitoring infrastructure.

You will design topics, partitions, replication, and ensure reliability under load. The role emphasizes production-grade Linux engineering, Python scripting, CI/CD ownership (Jenkins), containers (Docker/Podman), IaC, observability, and GenAI-assisted development within a global team.

Qualifications

• Deep, hands-on production Kafka experience (4+ years).
• Linux engineering with automation and Python scripting.
• CI/CD ownership and release management exposure.
• Container orchestration and OCI images (Kubernetes).
• Infrastructure-as-code and configuration management.
• Observability tooling including logging, metrics, and SLOs.
• Experience with AI-assisted development in coding workflows.

Responsibilities

• Own the Kafka estate: design, partitioning, replication, retention, and broker config.
• Ensure platform resilience and handle degraded upstream services gracefully.
• Implement at-least-once and exactly-once semantics; dead-letter handling.
• Build streaming observability: lag, throughput, dashboards, alerts, tracing.
• Plan capacity, cost, and retention for regulatory audit needs.
• Integrate vendor streaming/CDC mechanisms as platforms mature.
• Own build/release pipelines with Jenkins for enterprise Linux distros.

Skills

Kafka

Linux

Python scripting

CI/CD

Jenkins

Docker/Podman

Kubernetes

IaC

Observability

GenAI tooling

Networking/TLS

Incident response

Communication

Tools

Jenkins

Docker

Podman

OCI images

Job description

AgileEngine is seeking an Infrastructure Engineer (Kafka) to own and operate the Kafka estate behind an event-driven integration platform, including its build, deployment, and monitoring infrastructure.

You will design topics, partitions, replication, and ensure reliability under load. The role emphasizes production-grade Linux engineering, Python scripting, CI/CD ownership (Jenkins), containers (Docker/Podman), IaC, observability, and GenAI-assisted development within a global team.