Kafka Infrastructure Engineer - Remote, Platform Ownership

AgileEngine, LLC.; Alicante; Hybrid; EUR 107.000 - 161.000; Vollzeit

Benefits dieser Stelle

Professional growth

Competitive USD-based compensation

Exciting projects

Flextime with remote and office option

Zusammenfassung

AgileEngine is seeking an Infrastructure Engineer (Kafka) to own and operate a Kafka estate behind an event-driven platform. You will design topics, manage partitions, and ensure resilient delivery with proper monitoring and governance.

In this role, you will also build and maintain Jenkins pipelines, containerized deployments, and IaC for scalable, compliant operations. A strong Linux background and Python scripting are essential for success in a global, fast-paced environment.

Qualifikationen

• 4+ years of hands-on production Kafka experience; topic/partition design and lag troubleshooting.
• Experience with event-driven delivery semantics: at-least-once vs exactly-once; idempotency and replay.
• Strong Linux engineering and automation; Python scripting proficiency.
• CI/CD ownership, ideally Jenkins declarative pipelines with artifact/release management.
• Container experience with Docker/Podman and OCI images; container orchestration familiarity.
• Infrastructure-as-code and configuration management across environments.
• Observability tooling: log aggregation, metrics, alerting, and SLOs.
• Experience with GenAI-assisted development and AI coding agents in daily workflow.
• Networking, TLS, secrets management, and enterprise authentication (OAuth2).
• Production operations mindset: incident response, capacity planning, change control.
• Strong written and verbal communication; ability to work with a global team.

Aufgaben

• Own the Kafka estate: topic naming standards, partitioning, replication, and retention policy.
• Ensure platform resilience and reliability during upstream service degradation or spikes.
• Implement delivery guarantees: at-least-once/exactly-once, idempotent producers, dead-letter handling.
• Build streaming observability: lag, throughput, dashboards, and SLOs with end-to-end tracing.
• Plan capacity, cost, and retention for durable logs with regulatory needs; optimize as adoption grows.
• Evaluate vendor-native streaming and change-data-capture mechanisms for ingress/egress paths.
• Own and evolve build and release pipelines: Jenkins pipelines, signed container images, docs.
• Operate runtime estate: container deployments, gateway hosts, OS modernization.
• Automate environment provisioning and maintain single source of truth for assets.
• Collaborate with Python developers on performance, cost, and deployment.

Kenntnisse

Kafka

Event-driven semantics

Linux automation

Python scripting

CI/CD ownership

Docker/Podman

OCI images

IaC & config mgmt

Observability

GenAI development

Networking TLS/OAuth2

Incident response

Communication

Tools

Jenkins

Docker

Kubernetes

Jobbeschreibung

AgileEngine is seeking an Infrastructure Engineer (Kafka) to own and operate a Kafka estate behind an event-driven platform. You will design topics, manage partitions, and ensure resilient delivery with proper monitoring and governance.

In this role, you will also build and maintain Jenkins pipelines, containerized deployments, and IaC for scalable, compliant operations. A strong Linux background and Python scripting are essential for success in a global, fast-paced environment.