Applied Scientist: Adaptive Model Routing & Agent Evaluation

Bitdeer (NASDAQ: BTDR); Singapore; On-site; SGD 120,000 - 240,000; Full time

Job summary

Bitdeer AI Lab in Singapore is seeking a researcher to develop evaluation pipelines for agentic inference and to prototype adaptive model-routing strategies. You will work on LLM evaluation, tool usage, and performance metrics across cost, latency, and token consumption.

You will collaborate with MaaS and platform teams to move prototypes toward production, focusing on reliability, access control, and SLA considerations.

Qualifications

• Hands‑on experience in LLM evaluation and agentic systems.
• Strong Python and PyTorch skills; able to build experimental pipelines.
• Experience with evaluation metrics, regression testing, and analysis.

Responsibilities

• Build evaluation systems for agentic inference and measure trajectory-level performance.
• Research routing strategies and implement production integration with MaaS/platform teams.

Skills

LLM evaluation

agent systems

Python

PyTorch

evaluation pipelines

routing policies

uncertainty estimation

A/B testing

multi-model APIs

tool calling

production monitoring

Education

Bachelor’s, Master’s, or PhD in CS/ML/EE

Tools

Python

PyTorch

Job description

Bitdeer AI Lab in Singapore is seeking a researcher to develop evaluation pipelines for agentic inference and to prototype adaptive model-routing strategies. You will work on LLM evaluation, tool usage, and performance metrics across cost, latency, and token consumption.

You will collaborate with MaaS and platform teams to move prototypes toward production, focusing on reliability, access control, and SLA considerations.