Event Streaming Engineer - Kafka / Azure Event Hubs

Coforge Limited; Canada; On-site; CAD 105,000 - 145,000; Full time

Job summary

Coforge Limited is seeking a Senior Event Streaming Engineer / Lead to design and implement event-driven integration solutions leveraging Azure Event Hubs and Apache Kafka. The role involves configuring hubs, partitions, consumer groups and retention, while ensuring secure access and thorough testing of end-to-end flows.

You will design ingestion pipelines, manage schema compatibility with JSON/Avro, and implement robust monitoring and documentation to support production readiness.

Qualifications

• Hands-on experience with Azure Event Hubs and Apache Kafka.
• Strong knowledge of Kafka producers, consumers, topics, partitions, offsets and delivery semantics.
• Experience with event-driven architecture, serialization and schema compatibility.
• Practical knowledge of Azure security, identity, RBAC and credential management.
• Ability to independently design, develop, troubleshoot and test end-to-end integrations.

Responsibilities

• Design event-driven integrations, including Kafka connectivity, topic mapping and partitioning.
• Configure Event Hubs, partitions, consumer groups, retention and throughput settings with Cloud Engineering.
• Implement secure authentication, Microsoft Entra ID and least-privilege access controls.
• Develop event ingestion and downstream consumer integrations using Kafka or Azure SDKs.
• Implement retry, recovery, duplicate handling, replay and end-to-end reliability testing.
• Establish monitoring, alerting, runbooks and technical documentation.

Skills

Azure Event Hubs

Apache Kafka

Kafka topics

Partitions management

RBAC & Azure security

End-to-end integrations design

C#/.NET development

Schema registry (JSON/Avro)

Tools

Terraform

CI/CD pipelines

Azure Monitor / Log Analytics

Bicep

Job description

We are looking for a Senior Event Streaming Engineer / Lead to design and implement event-driven integration solutions using Azure Event Hubs and Apache Kafka.

Responsibilities

• Design event-driven integrations, including Kafka connectivity, topic mapping, partitioning, and schema management.
• Configure Event Hubs, partitions, consumer groups, retention, and throughput settings in collaboration with Cloud Engineering.
• Implement secure authentication, Microsoft Entra ID, RBAC, and least-privilege access controls.
• Develop event ingestion and downstream consumer integrations using Kafka-compatible interfaces or Azure SDKs.
• Implement retry, recovery, duplicate handling, replay, and end-to-end reliability testing.
• Establish monitoring, alerting, operational runbooks, and technical documentation.

Required Skills

• Hands-on experience with Azure Event Hubs and Apache Kafka.
• Strong knowledge of Kafka producers, consumers, topics, partitions, offsets, and delivery semantics.
• Experience with event-driven architecture, serialization, and schema compatibility.
• Practical knowledge of Azure security, identity, RBAC, and credential management.
• Ability to independently design, develop, troubleshoot, and test end-to-end integrations.

Preferred Skills

• C#/.NET development for Kafka integrations or bridge solutions.
• Experience with JSON, Avro, and schema registries.
• Familiarity with Azure Monitor, Log Analytics, Terraform/Bicep, and CI/CD.
• Knowledge of high availability, disaster recovery, and production support.
• Azure or Kafka certifications are an advantage.