Onsite Kafka & Debezium Data Ingestion Engineer

N Consulting Limited; Eindhoven; Hybrid; EUR 70,000 - 100,000; Full time

Job summary

N Consulting Limited is hiring a Debezium and Kafka Connect Application Developer in Eindhoven, NL. The role focuses on building robust CDC pipelines using Debezium to stream data to a data lakehouse within AWS, Dockerized and managed on ECS/ECR.

You'll own end-to-end pipeline lifecycles, implement IaC with Terraform, and maintain CI/CD pipelines with GitHub Actions. Hybrid/onsite work with a strong emphasis on reliability and data integrity.

Qualifications

• Hands-on Kafka Connect/ Debezium experience in production environments.
• Strong Docker experience and container lifecycle management.
• Proven AWS ECS/ECR deployment and maintenance capabilities.

Responsibilities

• Develop and maintain CDC ingestion pipelines with Kafka Connect.
• Containerize and deploy Debezium and Kafka Connect workloads on AWS.
• Manage data ingestion to S3 with Parquet and Iceberg formats.
• Implement Terraform provisioning and CI/CD pipelines with GitHub Actions.
• Monitor health and reliability of the data platform; troubleshoot issues.
• Optional: support Airflow-based workflow orchestration.

Skills

Kafka Connect

Docker

AWS ECS

Terraform

GitHub Actions

Python

Bash

Airflow

Tools

AWS ECR

Parquet/ Iceberg

CI/CD pipelines

Job description

N Consulting Limited is hiring a Debezium and Kafka Connect Application Developer in Eindhoven, NL. The role focuses on building robust CDC pipelines using Debezium to stream data to a data lakehouse within AWS, Dockerized and managed on ECS/ECR.

You'll own end-to-end pipeline lifecycles, implement IaC with Terraform, and maintain CI/CD pipelines with GitHub Actions. Hybrid/onsite work with a strong emphasis on reliability and data integrity.