Lead AI Engineer

KUAILU SOFTWARE (SINGAPORE) PTE. LTD.; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

KUAILU SOFTWARE (SINGAPORE) PTE. LTD. is seeking a specialist to build end-to-end training data pipelines for LLMs, covering cleaning, deduplication, format conversion, quality filtering, data mixture, and version management.

You will design and adjust the data mix between SFT data and Replay data, and manage the Prompt pool for distillation. Collaborate with AI engineers to convert ReAct trajectories and Function Calling workflows into training-ready formats, with thorough data versioning and

Qualifications

• Bachelor’s degree or above in Computer Science, Artificial Intelligence, Data Science, or a related field.
• Proficient in Python and familiar with data processing frameworks such as pandas, with hands-on experience processing large-scale text datasets.
• Experience building LLM SFT/RLHF data pipelines, with a solid understanding of best practices in data deduplication, quality filtering, and data mixture/formulation.
• Familiarity with ChatML/Chat formats, Function Calling data formats, and multi-turn conversational data structures.
• Experience in data quality measurement, monitoring, and data version management.

Responsibilities

• Build and maintain end-to-end training data pipelines for LLMs: cleaning, deduplication, format conversion, quality filtering, data mixture, and version management.
• Design and adjust the data mix ratio between SFT training data and Replay data.
• Manage the Prompt pool for distillation training, including prompt collection, deduplication, and balanced sampling across domains.
• Establish a two-level automated and manual sampling-based quality control framework for format validation, semantic deduplication, and persona consistency checks.
• Collaborate with Agent Algorithm Engineers to convert ReAct multi-turn trajectories and Function Calling workflows into training-ready data formats.
• Manage training data versioning and traceability with fully documented data snapshots and change records.

Skills

Python

Pandas

Data pipelines

LLM SFT/RLHF

Data quality

Versioning

Education

Bachelor’s degree (CS/AI/DS)

Tools

ChatML

Function Calling

Job description

Job Description

• Build and maintain end-to-end training data pipelines for Large Language Models (LLMs), covering data cleaning, deduplication, format conversion, quality filtering, data mixture/formulation, and version management.
• Design and dynamically adjust the data mix ratio between SFT training data and general-purpose Replay data.
• Manage the Prompt pool for distillation training, including prompt collection, deduplication, and balanced sampling across different domains.
• Establish a comprehensive data quality assurance framework, implementing a two-level automated and manual sampling-based quality control process covering format validation, semantic deduplication, and persona consistency checks.
• Collaborate with Agent Algorithm Engineers to convert ReAct multi-turn reasoning trajectories and Function Calling workflows into training-ready data formats.
• Manage training data versioning and traceability, ensuring that data snapshots and change records for each training iteration are fully documented and traceable.

Job Requirements

• Bachelor’s degree or above in Computer Science, Artificial Intelligence, Data Science, or a related field.
• Proficient in Python and familiar with data processing frameworks such as pandas, with hands-on experience processing large-scale text datasets.
• Experience building LLM SFT/RLHF data pipelines, with a solid understanding of best practices in data deduplication, quality filtering, and data mixture/formulation.
• Familiarity with ChatML/Chat formats, Function Calling data formats, and multi-turn conversational data structures.
• Experience in data quality measurement, monitoring, and data version management.