Kafka Infrastructure Engineer | Remote + Flexible Hours

AgileEngine, LLC.; Aveiro; Hybrid; EUR 80,000 - 133,000; Full time

Benefits offered by this job

Professional growth

Competitive compensation

Exciting projects

Flextime

Job summary

AgileEngine is seeking an Infrastructure Engineer (Kafka) to own and operate the Kafka estate behind an event-driven integration platform. You will design topics, manage partitions, retention, and broker configuration while ensuring resilience during upstream outages.

You will implement at-least-once/Exactly-once semantics, build observability, and own CI/CD pipelines (Jenkins) with container-based deployments.

Qualifications

• 4+ years of production Kafka experience, including design, tuning, and troubleshooting under load.
• Experience with event-driven delivery semantics and idempotency.
• Strong Linux engineering and automation skills (shell, Python).
• Hands-on CI/CD pipeline ownership and release management.
• Container orchestration experience and OCI image management.
• Infrastructure-as-code and configuration management experience.
• Observability tooling, logging, metrics, and SLO definitions.
• Familiarity with AI-assisted development and coding agents.
• Networking, TLS, secrets management and OAuth2.
• Production operations mindset: incident response and capacity planning.

Responsibilities

• Own the Kafka estate: topic design, partitioning, replication, retention, and broker config.
• Maintain platform resilience when upstream services degrade; absorb traffic spikes safely.
• Implement exact-at-least-once semantics and idempotent producers where needed.
• Build streaming observability: lag, throughput, dashboards, and end-to-end tracing.
• Plan capacity and retention for regulatory audit requirements.
• Operate build/release pipelines: Jenkins, packaged installs, signed images.
• Manage runtime estate: containerized deployments and OS modernization.
• Automate environment provisioning and maintain single source of truth inventory.
• Collaborate with Python developers on performance and cost.

Skills

Kafka expert

Linux

Python scripting

CI/CD ownership

Containerization

Tools

Jenkins

Docker/Podman

OCI images

Job description

AgileEngine is seeking an Infrastructure Engineer (Kafka) to own and operate the Kafka estate behind an event-driven integration platform. You will design topics, manage partitions, retention, and broker configuration while ensuring resilience during upstream outages.

You will implement at-least-once/Exactly-once semantics, build observability, and own CI/CD pipelines (Jenkins) with container-based deployments.