Messaging & Streaming Infrastructure Engineer

PAN-ASIA RESOURCES PTE LTD; Singapore; On-site; SGD 90,000 - 120,000; Full time

Job summary

PAN-ASIA RESOURCES PTE LTD is seeking a skilled Messaging Platform Engineer to design, implement, and maintain real-time data exchange between factory automation, MES, and enterprise IT systems. You will deploy Kafka and MQTT, enable streaming across devices and cloud apps, and manage topics, data schemas, and pipelines.

The role requires strong programming in Java/Scala/Python and deep knowledge of distributed messaging with fault tolerance.

Qualifications

• Strong experience with message-oriented middleware and streaming platforms.
• Hands-on production experience with Apache Kafka.
• Experience with RabbitMQ, IBM MQ, Apache Pulsar, or MQTT is an advantage.
• Experience with Kafka Connect or MQTT clients for device and application integration.
• Strong programming skills in Java, Scala, or Python.
• Good understanding of distributed messaging systems, consumer groups, offset management, retention policies, and delivery guarantees.
• Experience in manufacturing, factory automation, MES, IoT, or industrial systems is preferred.

Responsibilities

• Design, implement, and maintain messaging infrastructure for real-time data exchange between factory automation systems, MES, and enterprise IT platforms.
• Deploy and manage distributed messaging platforms such as Apache Kafka and MQTT.
• Enable real-time data streaming between shop-floor equipment, sensors, cloud platforms, and enterprise applications.
• Define and manage message topics, channels, and data schemas for equipment status, test results, alarms, and other events.
• Design real-time data pipelines using Pub/Sub patterns with high throughput, scalability, and fault tolerance.
• Develop and optimize message producers and consumers using Java, Scala, or Python.
• Configure and manage Kafka topics, partitions, replication, broker clusters, retention policies, consumer groups, and offset management.
• Monitor and troubleshoot messaging infrastructure to ensure reliable and efficient data delivery.

Skills

Message-oriented middleware

Kafka

RabbitMQ

MQTT

Kafka Connect

Java

Scala

Python

Distributed messaging

Industrial systems

Job description

Job Description:

• Design, implement, and maintain messaging infrastructure supporting real-time data exchange between factory automation systems, MES, and enterprise IT platforms.


• Deploy and manage distributed messaging platforms such as Apache Kafka and MQTT.


• Enable real-time data streaming between shop-floor equipment, sensors, cloud platforms, and enterprise applications.


• Define and manage message topics, channels, and data schemas for equipment status, test results, alarms, and other events.


• Design real-time data pipelines using Pub/Sub patterns with a focus on high throughput, scalability, and fault tolerance.


• Develop and optimize message producers and consumers using Java, Scala, or Python.


• Configure and manage Kafka topics, partitions, replication, broker clusters, retention policies, consumer groups, and offset management.


• Monitor and troubleshoot messaging infrastructure to ensure reliable and efficient data delivery.

Requirements:

• Strong experience with message-oriented middleware and streaming platforms.


• Hands-on production experience with Apache Kafka preferred.


• Experience with RabbitMQ, IBM MQ, Apache Pulsar, or MQTT is an advantage.


• Experience with Kafka Connect or MQTT clients for device and application integration.


• Strong programming skills in Java, Scala, or Python.


• Good understanding of distributed messaging systems, consumer groups, offset management, retention policies, and delivery guarantees.


• Experience in manufacturing, factory automation, MES, IoT, or industrial systems is preferred.

This position is open to all who are fulfilling aforesaid requirement