Real-Time Messaging Engineer: Kafka & Data Pipelines

APAR TECHNOLOGIES PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

APAR TECHNOLOGIES PTE. LTD. is seeking a seasoned Messaging Engineer to design, implement and support real-time data exchange systems in a fast-paced environment.

You will deploy distributed messaging platforms like Kafka, define topics, and optimize configurations for reliability and latency. The role requires extensive experience with Kafka, pub/sub patterns, and programming in Java/Scala/Python. You will collaborate with developers to integrate applications and ensure high-throughput

Qualifications

• Minimum 5 years of total IT experience.
• At least 2 years of relevant experience in Messaging Engineering.
• Strong hands-on experience with Apache Kafka in production.
• Experience with message-oriented middleware and streaming platforms.
• Experience with Kafka topics, partitioning, replication, broker configuration, consumer groups, and offset management.
• Experience designing real-time data pipelines using pub/sub patterns.
• Strong programming skills in Java, Scala, or Python.

Responsibilities

• Design, implement, maintain, and support messaging infrastructure for real-time data exchange.
• Deploy and manage distributed messaging platforms, including Apache Kafka.
• Define and manage message topics, channels, and data schemas.
• Configure and optimize messaging systems for high throughput, low latency, and reliability.
• Monitor messaging platforms and troubleshoot issues related to throughput, lag, errors, and message delivery.
• Work with development teams to integrate applications with messaging platforms.
• Support producer and consumer performance tuning.
• Manage messaging system configurations, including partitioning, replication, retention, and consumer groups.
• Support continuous improvement of messaging infrastructure and operational processes.

Skills

Kafka

Java/Scala/Python

Messaging systems

Real-time pipelines

Pub/Sub patterns

Troubleshooting

Production experience

Job description

APAR TECHNOLOGIES PTE. LTD. is seeking a seasoned Messaging Engineer to design, implement and support real-time data exchange systems in a fast-paced environment.

You will deploy distributed messaging platforms like Kafka, define topics, and optimize configurations for reliability and latency. The role requires extensive experience with Kafka, pub/sub patterns, and programming in Java/Scala/Python. You will collaborate with developers to integrate applications and ensure high-throughput