Senior Kafka Infrastructure Engineer — Remote & Flexible

AgileEngine, LLC.; Valencia; Hybrid; EUR 107,000 - 160,000; Full time

Benefits offered by this job

Professional growth

Competitive compensation

Exciting projects

Flextime

Job summary

AgileEngine, LLC. is seeking an Infrastructure Engineer (Kafka) to own and operate the Kafka estate behind an event-driven integration platform. You will manage build, deployment, and monitoring infrastructure to ensure resilience and replayability of events.

The role emphasizes production Kafka experience, Linux automation with Python, and strong CI/CD ownership. Remote/office flexible, join a team delivering enterprise-grade streaming solutions.

Qualifications

• Deep, hands-on production Kafka experience of 4+ years is required.
• Understanding of event-driven delivery semantics (at-least-once vs exactly-once).
• Strong enterprise Linux engineering and automation; Python scripting.
• CI/CD pipeline ownership, preferably Jenkins declarative pipelines.
• Containerization and orchestration experience (Docker/Podman, Kubernetes).
• Infrastructure-as-code and configuration management expertise.
• Observability tooling, logging, metrics, alerting, and SLOs.
• GenAI-assisted development familiarity with AI coding agents.
• Networking, TLS, secrets management and OAuth2.
• Production operations mindset: incident response and change control.

Responsibilities

• Own the Kafka estate: topic design, partitioning, replication, retention, and broker config upgrades.
• Ensure platform resilience during upstream outages and scale events.
• Implement at-least-once and exactly-once semantics, idempotent producers.
• Develop streaming observability: lag, throughput, dashboards, and alerting.
• Plan capacity and retention for regulatory audit requirements.
• Evaluate vendor-native streaming and CDC mechanisms.
• Own build/release pipeline: Jenkins pipelines and signed container images.
• Operate containerized deployments and runtime estate.
• Automate provisioning and maintain single source of truth for configs.
• Collaborate with Python developers on deployability, performance and cost.

Skills

Kafka production experience

Event-driven delivery semantics

Linux shell scripting

CI/CD ownership

Automation

Observability and monitoring

GenAI in development

Networking and TLS

Incident response and change control

Technical communication

Tools

Docker/Podman

Kubernetes

Jenkins

OCI container images

Terraform

Git

Prometheus/Grafana

Job description

AgileEngine, LLC. is seeking an Infrastructure Engineer (Kafka) to own and operate the Kafka estate behind an event-driven integration platform. You will manage build, deployment, and monitoring infrastructure to ensure resilience and replayability of events.

The role emphasizes production Kafka experience, Linux automation with Python, and strong CI/CD ownership. Remote/office flexible, join a team delivering enterprise-grade streaming solutions.