Kafka Infrastructure Engineer — Remote & Flexible

AgileEngine, LLC.; Coimbra; Hybrid; EUR 107,000 - 160,000; Full time

Benefits offered by this job

Professional growth

Competitive USD-based compensation

Exciting projects with Fortune 500/TOP

Job summary

AgileEngine, LLC. is seeking an Infrastructure Engineer (Kafka) to own and operate the Kafka estate behind a scalable event-driven platform. You will build, deploy, and monitor the infrastructure, ensuring resilience and correct delivery semantics.

You will design partitioning, retention, and broker configuration, while advancing observability and cost-aware capacity planning in a hybrid remote/office setup.

Qualifications

• 4+ years of hands-on production Kafka experience with topic/partition design, consumer groups, retention, replication, and performance tuning.
• Understanding of at-least-once vs exactly-once delivery, idempotency, ordering guarantees, and dead-letter handling.
• Strong Linux engineering and automation skills; proficient with shell and Python scripting.
• CI/CD ownership, ideally Jenkins declarative pipelines, with artifact and release management.
• Containerization and orchestration experience (Docker/Podman, Kubernetes).
• Infrastructure-as-code and config management experience.
• Observability tooling: logging, metrics, alerting, and SLO definitions.
• Experience with AI-assisted development tools and workflows.

Responsibilities

• Own the Kafka estate design, partitioning, replication, retention, and broker configuration.
• Ensure platform resilience and handle degradation scenarios for upstream SaaS integrations.
• Implement delivery guarantees (at-least-once/ exactly-once) with idempotent producers and dead-letter topics.
• Develop streaming observability—lag, throughput, dashboards, tracing, and alerting.
• Plan capacity, cost, and retention for durable logs with audit requirements.
• Evaluate and integrate vendor-native streaming and change-data-capture mechanisms.
• Own build and release pipelines (Jenkins) producing packaged installs and signed images.
• Operate runtime estate: container deployments, gateways, and OS modernization.
• Automate environment provisioning and configuration as a single source of truth.
• Collaborate with Python developers on performance and cost optimization; support production.

Skills

Kafka

Linux

Python scripting

CI/CD

Docker/Podman

Observability

Security and auth

Tools

Jenkins

Kubernetes

Job description

AgileEngine, LLC. is seeking an Infrastructure Engineer (Kafka) to own and operate the Kafka estate behind a scalable event-driven platform. You will build, deploy, and monitor the infrastructure, ensuring resilience and correct delivery semantics.

You will design partitioning, retention, and broker configuration, while advancing observability and cost-aware capacity planning in a hybrid remote/office setup.