Kafka Infrastructure Engineer — Remote & Flexible

AgileEngine, LLC.; Lisboa; Híbrido; EUR 107 000 - 142 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Professional growth

Competitive USD-based compensation

Exciting projects

Flextime

Resumo da oferta

AgileEngine, LLC. is seeking an experienced Infrastructure Engineer (Kafka) to own and operate the Kafka estate behind our event-driven integration platform. You will manage build, deployment, monitoring, and delivery guarantees in a scalable, secure environment.

You will design topic schemas, ensure resilience, implement exactly-once semantics where needed, and build observability dashboards. The role also involves modernizing the runtime, automation, and collaboration with Python developers to

Qualificações

• Deep, hands-on production Kafka experience of 4+ years, including design, replication and tuning.
• Strong Linux engineering and automation, with Python scripting.
• Proven ownership of CI/CD pipelines and release management (e.g., Jenkins).
• Experience with containers and orchestration (Docker/Podman, Kubernetes).
• Experience with infrastructure as code and configuration management.
• Familiarity with observability, logging, metrics, and SLOs.
• Interest or experience with AI-assisted development in daily workflows.

Responsabilidades

• Own the Kafka estate: topic design, partitioning, replication, retention, and broker config.
• Ensure platform resilience and availability during upstream SaaS degradation.
• Implement at-least-once and exactly-once semantics, dead-letter handling, and replay tooling.
• Build streaming observability: lag, throughput, tracing, dashboards, and alerts.
• Plan capacity, cost, and retention for a durable log with audit retention.
• Evaluate and integrate vendor-native streaming and change-data-capture mechanisms.
• Own and evolve the build and release pipeline with Jenkins pipelines and signed artifacts.
• Operate runtime estate: containerised deployments and gateway hosts.
• Automate environment provisioning and keep a single source of truth for configurations.
• Collaborate with Python developers on deployability, performance, and cost.

Conhecimentos

Kafka

Python scripting

Linux

CI/CD

Jenkins

Docker

Kubernetes

Observability

AI-assisted development

Ferramentas

Jenkins

Docker

Podman

OCI images

Kubernetes

Descrição da oferta de emprego

AgileEngine, LLC. is seeking an experienced Infrastructure Engineer (Kafka) to own and operate the Kafka estate behind our event-driven integration platform. You will manage build, deployment, monitoring, and delivery guarantees in a scalable, secure environment.

You will design topic schemas, ensure resilience, implement exactly-once semantics where needed, and build observability dashboards. The role also involves modernizing the runtime, automation, and collaboration with Python developers to