Data Developer(A18339)

AI Rudder; Kuala Lumpur; On-site; MYR 90,000 - 130,000; Full time

Benefits offered by this job

AI/LLM projects

Growth potential

Competitive pay

Job summary

AI Rudder is building a data-heavy platform that uses AI voice automation to boost call center efficiency. The role focuses on designing scalable data pipelines and systems in a cross-functional team spanning China and Southeast Asia.

You will work with Kafka, HBase, Spark, and Flink, collaborating with data scientists and engineers to deliver robust data solutions and maintain system reliability.

Qualifications

• Experience with Kafka, HBase and Spark in production environments.
• Proficient in Java or Scala with 1+ year of development; Golang is a plus.
• Fluent English for technical discussions and collaboration.
• Understanding of distributed systems concepts: data consistency, fault tolerance, load balancing.

Responsibilities

• Design, develop, and optimize high-performance data pipelines and processing workflows (Kafka, HBase, Spark, Flink).
• Handle massive volumes of structured and unstructured data for real-time and batch processing.
• Monitor, tune, troubleshoot, and operate big data clusters for reliability and stability.
• Collaborate with data scientists, analysts, product managers, and engineers to translate requirements into robust solutions.
• Produce clear technical documentation and follow data governance and coding best practices.

Skills

Kafka

HBase

Spark

Java

Scala

Golang

Distributed systems

Fluent English

Mandarin

Tools

Flink

Airflow

Kubernetes

Hive

Iceberg

Delta Lake

Job description

AI Rudder is a software company that harnesses the power of AI voice automation to supercharge customer experiences. With AI voice assistants, your call center can make quality human-like calls at lightning speeds, collecting and analysing data automatically to reach and activate more customers. AI Rudder helps call centers reduce costs by automating repetitive tasks and lowering agent workload. This free up agents to focus on things only humans can do. Over the long term, AI Rudder aims to rethink the future of business communication.

Responsibilities:

• Design, develop, and optimize high-performance, scalable data pipelines and processing workflows using frameworks such as Kafka, HBase, Spark, and Flink.
• Handle massive volumes of structured and unstructured data, supporting both real-time streaming and offline batch processing scenarios.
• Monitor, performance-tune, troubleshoot, and perform daily operations of big data clusters to ensure system stability and reliability.
• Work closely with data scientists, analysts, product managers, and other engineers to understand requirements and translate them into robust technical solutions.
• Produce clear technical documentation and adhere to team best practices for code development and data governance.

Requirements:

Must-have:

• In-depth understanding and hands-on development experience with big data components such as Kafka, HBase, and Spark.
• Proficient in Java or Scala, with at least 1+ years of development experience in one of them (Java/Scala); experience with Golang is a strong plus.
• Fluent in English (written and spoken) for technical discussions and daily collaboration.
• Familiar with distributed system principles and concepts like data consistency, fault tolerance, and load balancing.

Nice-to-have:

• Familiarity with big data services on cloud platforms (e.g., AWS EMR/MSK, GCP Dataproc/Dataflow, Azure HDInsight/Event Hubs).
• Experience with tools like Flink, Airflow, Kubernetes.
• Understanding of data lake/warehouse concepts and related technologies (e.g., Hive, Iceberg, Delta Lake).
• Fluent in Mandarin.

What we offer:

• Core role in building a high-impact R&D center from the ground up in Southeast Asia.
• Direct involvement in cutting-edge AI + LLM product innovation, shaping user-facing experiences.
• Competitive compensation package with growth potential as the team scales.
• Collaborative environment bridging China and Southeast Asia engineering cultures.