Remote Kafka Infrastructure Engineer

AgileEngine, LLC.; Granada; Remote; EUR 107,000 - 160,000; Full time

Benefits offered by this job

Professional growth

Competitive pay USD-based

Exciting projects

Flextime

Job summary

AgileEngine seeks an Infrastructure Engineer (Kafka) to own the Kafka estate behind our event-driven platform. You’ll design topic structures, manage replication and retention, and ensure resilience during vendor outages. You’ll drive CI/CD, containerized deployments, and integration with IaC and observability tools.

You’ll collaborate with Python developers on performance, cost, and scalability while advancing AI-assisted development practices across the squad.

Qualifications

• Deep, hands-on production Kafka experience of 4+ years.
• Event-driven delivery semantics, exactly-once vs at-least-once.
• Enterprise Linux engineering and Python scripting.
• CI/CD ownership with artifact and release management.
• Containerization and OCI images; orchestration basics.
• Infrastructure-as-code and configuration management.
• Observability through logs, metrics, and SLOs.
• GenAI-assisted development in daily workflow.
• Networking, TLS, secrets management, OAuth2.
• Production operations mindset with incident response.

Responsibilities

• Own the Kafka estate: design, partitioning, replication and retention.
• Maintain platform resilience and handle upstream outages gracefully.
• Implement at-least-once and exactly-once semantics; dead-letter handling.
• Build streaming observability: lag, throughput, dashboards and alerts.
• Plan capacity and retention for regulatory audit needs.
• Integrate vendor streaming / change-data-capture as needed.
• Own build and release pipelines: Jenkins, signed images, docs.
• Operate runtime estate: container deployments and OS modernization.
• Automate provisioning and keep a single source of truth.
• Collaborate with Python developers on performance and cost.

Skills

Kafka

Linux engineering

Python scripting

CI/CD pipelines

Containers

IaC

Observability

GenAI tooling

Networking

Incident response

Tools

Jenkins

Docker/Podman

OCI images

Kubernetes

Job description

AgileEngine seeks an Infrastructure Engineer (Kafka) to own the Kafka estate behind our event-driven platform. You’ll design topic structures, manage replication and retention, and ensure resilience during vendor outages. You’ll drive CI/CD, containerized deployments, and integration with IaC and observability tools.

You’ll collaborate with Python developers on performance, cost, and scalability while advancing AI-assisted development practices across the squad.