Messaging Engineer

V4 IMPACT PTE. LTD.; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

V4 IMPACT PTE. LTD. is seeking a skilled professional to design, deploy, and optimize real-time messaging infrastructure connecting factory automation, MES, and enterprise IT platforms.

You will manage distributed brokers (Kafka, MQTT) and define topics, schemas, and data flows to ensure low latency and high reliability. You will collaborate with developers to integrate applications, tune producers/consumers, and implement monitoring/alerting to track throughput, lag, and errors, ensuring robust

Qualifications

• Strong expertise in message-oriented middleware and streaming platforms.
• Hands-on experience deploying or managing Apache Kafka (preferred) or similar technologies in production environments.
• Proficiency in designing real-time data pipelines with pub/sub patterns.

Responsibilities

• Design, implement, and maintain messaging infrastructure for real-time data exchange between factory automation systems, MES, and enterprise IT platforms.
• Define and govern message topics/channels and data schemas for consistent event structures.
• Optimize messaging setup for low latency and high reliability with monitoring and alerting for throughput, lag, and error rates.

Job description

Core Responsibilities:

Design, implement, and maintain the messaginginfrastructure that underpins real-time data exchange between factoryautomation systems, the MES, and enterprise IT platforms. Deploy and managedistributed message brokers (such as Apache Kafka clusters or MQTT-basedsystems) to enable streaming communication from shop-floor equipment andsensors to cloud or data center applications.

Define and govern message topics/channels and dataschemas to ensure consistent structure for all events (e.g. equipment statusupdates, test results, alarm signals) flowing through the system.

Optimize the messaging setup for low latency and highreliability, so that critical events propagate instantly and without loss orduplication. Implement monitoring and alerting for the messaging pipeline –tracking metrics like throughput, lag, and error rates – and quicklytroubleshoot any issues in message flow health.

Collaborate with other developers to integrate theirapplications with the messaging layer, and assist in tuning producer/consumerperformance to meet factory throughput demands.

Must Have Skills:

Strong expertise in message-oriented middleware andstreaming platforms. Hands-on experience deploying or managing Apache Kafka(preferred) or similar technologies (e.g. RabbitMQ, IBM MQ, Apache Pulsar) in aproduction environment – including topic design, partitioning, replication, andbroker configuration. Proficiency in designing real-time data pipelines withpub/sub patterns, ensuring high throughput and fault tolerance (e.g. usingKafka Connect or MQTT clients to interface with devices and applications).

Solid programming skills (Java/Scala or Python) fordeveloping producers and consumers, and optimizing them for performance.

Familiarity with messaging system internals (brokerclustering, retention policies, consumer groups, offset management) tofine-tune the system for optimal delivery guarantees.

Good to Have Skills:

Experience with messaging in industrial/IoT contexts,such as using MQTT or AMQP protocols to collect data from PLCs or IoT sensors.Knowledge of data serialization formats and schema management, for example,using Avro or Protocol Buffers and a Schema Registry to enforce consistentmessage structure across services.

Proficiency in monitoring tools and practices forstreaming systems (e.g. Kafka monitoring via Prometheus/Grafana, or cloudservices monitoring) and experience setting up alerts/dashboard for proactiveincident response.

Familiarity with other integration patterns (likeenterprise service bus architectures or event-driven microservices) andunderstanding of how messaging integrates with the overall factory IT landscape(MES, databases, analytics) would be beneficial.