Kafka Infrastructure Engineer — Remote & Flexible

AgileEngine, LLC.; Porto; On-site; EUR 90,000 - 130,000; Full time

Benefits offered by this job

Professional growth

Competitive USD-based compensation and

Exciting projects with Fortune 500 and

Flextime with remote and office

Job summary

AgileEngine is seeking an Infrastructure Engineer (Kafka) to own and operate the Kafka estate behind an event-driven platform. You will design topics, manage partitions, replication and retention, and ensure resilience during upstream outages.

You will implement at-least-once and exactly-once semantics, build streaming observability, plan capacity and cost, and evolve the build/release pipelines with Jenkins. Hybrid of automation and Ops mindset across global teams.

Qualifications

• Deep, hands-on production Kafka experience (4+ years).
• Event-driven delivery semantics including exactly-once vs at-least-once and idempotency.
• Strong enterprise Linux engineering and automation with Python scripting.
• CI/CD pipeline ownership, Jenkins declarative pipelines, release management.
• Containers and container orchestration (Docker/Podman, Kubernetes) with OCI images.
• Infrastructure-as-code and configuration management.
• Observability tooling for logs, metrics, alerting, and SLOs.
• GenAI-assisted development and daily use of AI coding tools.
• Networking, TLS, secrets management and OAuth2 authentication.
• Production operations mindset: incident response, capacity planning, change control.
• Strong written and verbal communication with a global team.

Responsibilities

• Own the Kafka estate: topic design, partitioning, replication, retention and offsets.
• Ensure platform resilience and availability during upstream SaaS degradation.
• Implement at-least-once and exactly-once semantics, idempotent producers and transactions.
• Build streaming observability: lag, throughput, tracing, dashboards and alerts.
• Plan capacity, cost, and retention for durable logs with audit-retention.
• Evaluate vendor-native streaming and CDC mechanisms as the platform matures.
• Own and evolve the build/release pipeline with Jenkins for multiple Linux generations.
• Operate containerized deployments, gateway hosts, and OS modernization.
• Automate environment provisioning and maintain a single source of truth for config/assets.
• Collaborate with Python developers on deployability, performance and cost.

Skills

Kafka experience

Linux engineering

Python scripting

CI/CD pipelines

Docker/Podman

OCI images

Kubernetes

Infrastructure-as-code

Observability

AI tooling

Networking & security

Ops mindset

Communication

Tools

Jenkins pipelines

Docker/Podman

OCI images

Kubernetes

Job description

AgileEngine is seeking an Infrastructure Engineer (Kafka) to own and operate the Kafka estate behind an event-driven platform. You will design topics, manage partitions, replication and retention, and ensure resilience during upstream outages.

You will implement at-least-once and exactly-once semantics, build streaming observability, plan capacity and cost, and evolve the build/release pipelines with Jenkins. Hybrid of automation and Ops mindset across global teams.