Senior AI Systems Engineer — Multi-Model Routing

SignalPlus; Singapore; On-site; SGD 180,000 - 240,000; Full time

Job summary

SignalPlus is seeking a Senior AI Systems Engineer to design and operate multi-model production systems in Singapore or Hong Kong. You will create automated evaluation and routing pipelines, balance model quality with latency and cost, and ensure reliable model governance for diverse foundation models.

The role emphasizes building scalable model gateways, unified APIs, and tooling to support lifecycle management, rollout, rollback, and continuous improvement of AI service quality.

Responsibilities

• Design and implement model-routing strategies across multiple foundation models based on task type, complexity, quality requirements, latency, cost, and operational risk.
• Develop dynamic model-selection, arbitration, escalation, fallback, and ensemble mechanisms.
• Define routing policies and decision criteria for different task categories and production scenarios.
• Continuously improve routing performance using evaluation results, production data, and controlled experimentation.
• Distinguish and optimize for model capability rather than relying solely on availability-based failover or static rule-based routing.
• Define task taxonomies, evaluation dimensions, scoring criteria, and acceptance thresholds for different AI use cases.
• Design and maintain benchmark suites, golden datasets, annotation standards, and regression test sets.
• Build automated evaluation pipelines using deterministic checks, LLM-as-a-Judge, rubric-based scoring, pairwise comparison, and human evaluation where appropriate.
• Validate evaluation methods against human judgments and monitor judge consistency, bias, and drift.
• Establish continuous evaluation and regression mechanisms for model, prompt, data, and routing-policy changes.
• Ensure evaluation signals are reliable enough to support model comparison and routing decisions.
• Design and build scalable infrastructure for integrating and serving multiple proprietary and open-source models.

Job description

SignalPlus is seeking a Senior AI Systems Engineer to design and operate multi-model production systems in Singapore or Hong Kong. You will create automated evaluation and routing pipelines, balance model quality with latency and cost, and ensure reliable model governance for diverse foundation models.

The role emphasizes building scalable model gateways, unified APIs, and tooling to support lifecycle management, rollout, rollback, and continuous improvement of AI service quality.