Senior AI Data Engineer - LLM Training Pipelines & Quality

KUAILU SOFTWARE (SINGAPORE) PTE. LTD.; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

KUAILU SOFTWARE (SINGAPORE) PTE. LTD. is seeking a specialist to build end-to-end training data pipelines for LLMs, covering cleaning, deduplication, format conversion, quality filtering, data mixture, and version management.

You will design and adjust the data mix between SFT data and Replay data, and manage the Prompt pool for distillation. Collaborate with AI engineers to convert ReAct trajectories and Function Calling workflows into training-ready formats, with thorough data versioning and

Qualifications

• Bachelor’s degree or above in Computer Science, Artificial Intelligence, Data Science, or a related field.
• Proficient in Python and familiar with data processing frameworks such as pandas, with hands-on experience processing large-scale text datasets.
• Experience building LLM SFT/RLHF data pipelines, with a solid understanding of best practices in data deduplication, quality filtering, and data mixture/formulation.
• Familiarity with ChatML/Chat formats, Function Calling data formats, and multi-turn conversational data structures.
• Experience in data quality measurement, monitoring, and data version management.

Responsibilities

• Build and maintain end-to-end training data pipelines for LLMs: cleaning, deduplication, format conversion, quality filtering, data mixture, and version management.
• Design and adjust the data mix ratio between SFT training data and Replay data.
• Manage the Prompt pool for distillation training, including prompt collection, deduplication, and balanced sampling across domains.
• Establish a two-level automated and manual sampling-based quality control framework for format validation, semantic deduplication, and persona consistency checks.
• Collaborate with Agent Algorithm Engineers to convert ReAct multi-turn trajectories and Function Calling workflows into training-ready data formats.
• Manage training data versioning and traceability with fully documented data snapshots and change records.

Skills

Python

Pandas

Data pipelines

LLM SFT/RLHF

Data quality

Versioning

Education

Bachelor’s degree (CS/AI/DS)

Tools

ChatML

Function Calling

Job description

KUAILU SOFTWARE (SINGAPORE) PTE. LTD. is seeking a specialist to build end-to-end training data pipelines for LLMs, covering cleaning, deduplication, format conversion, quality filtering, data mixture, and version management.

You will design and adjust the data mix between SFT data and Replay data, and manage the Prompt pool for distillation. Collaborate with AI engineers to convert ReAct trajectories and Function Calling workflows into training-ready formats, with thorough data versioning and