Kafka Infrastructure Engineer — Remote & Flexible

AgileEngine, LLC.; Málaga; Hybrid; EUR 107,000 - 143,000; Full time

Benefits offered by this job

Professional growth

Competitive compensation

Exciting projects

Flextime

Job summary

AgileEngine, LLC. in Málaga, Spain seeks an experienced Infrastructure Engineer (Kafka) to own and operate the Kafka estate behind a robust event-driven platform.

You will design topics, manage replication and retention, and ensure reliability even when upstream services degrade. Responsibilities include building streaming observability, implementing at-least-once and exactly-once semantics, and driving automation across the build, release, and runtime estates.

Qualifications

• Deep, hands-on production Kafka experience of 4+ years with design, replication and tuning.
• Understanding of at-least-once vs exactly-once, idempotency, ordering and replay.
• Strong Linux engineering & automation; Python scripting.
• CI/CD ownership with Jenkins pipelines and artifact management.
• Docker/Podman containers and OCI images; orchestration.
• Infrastructure-as-code and configuration management.
• Observability: logs, metrics, alerts and SLOs.
• Familiarity with AI-assisted development in daily workflows.
• Networking, TLS, secrets management and OAuth2.
• Production ops mindset: incident response and capacity planning.
• Clear written and verbal communication in a global team.

Responsibilities

• Own the Kafka estate: topic design, partitioning, replication and retention policies.
• Ensure platform resilience and handle traffic spikes with auditable events.
• Implement at-least-once and exactly-once semantics; dead-letter handling.
• Build streaming observability: lag, throughput, dashboards and alerts.
• Plan capacity and retention for durable logs with audit requirements.
• Evaluate vendor-native streaming and CDC mechanisms.
• Own build/release: Jenkins pipelines, signed images, and docs.
• Operate runtime: container deployments and gateway hosts.
• Automate provisioning and keep single source of truth for config/assets.
• Collaborate with Python developers on deployability, performance and cost.

Skills

Kafka experience

Linux engineering

Python scripting

CI/CD pipelines

Docker/Podman

Infrastructure as code

Observability tooling

Networking & TLS

AI tooling familiarity

Tools

Jenkins

Kubernetes

Job description

AgileEngine, LLC. in Málaga, Spain seeks an experienced Infrastructure Engineer (Kafka) to own and operate the Kafka estate behind a robust event-driven platform.

You will design topics, manage replication and retention, and ensure reliability even when upstream services degrade. Responsibilities include building streaming observability, implementing at-least-once and exactly-once semantics, and driving automation across the build, release, and runtime estates.