Applied Scientist: Adaptive Model Routing & Agent Evaluation

Bitdeer (NASDAQ: BTDR)

Austin (TX)

On-site

USD 150,000 - 230,000

Full time

14 days+
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

Diversity culture
Open workspaces
Fast-growing environment
Impact on industry
Project exposure
Autonomy and growth
Training and mentoring

Job summary

Bitdeer AI Lab seeks a capable researcher to advance evaluation frameworks for agentic inference and LLM systems. You will own the evaluation pipeline, develop task suites, and study routing strategies while coordinating with MaaS and platform teams to deploy reliable, cost-aware solutions.

The role emphasizes rigorous experimentation, cross-disciplinary collaboration, and contribution to the cutting edge of AI-powered mining and cloud platforms.

Qualifications

  • Advanced degrees or equivalent hands-on work in ML/AI research and evaluation.
  • Experience designing or operating evaluation pipelines for LLMs or agents.
  • Proven ability to build reliable experimental pipelines and research prototypes.

Responsibilities

  • Build evaluation and decision systems for agentic inference; own and extend LLM evaluation pipeline; measure behavior across task success, tool use, cost, latency and tokens; prototype routing strategies; collaborate on production integration.

Skills

Python
PyTorch
LLM evaluation
Agentic systems
Experiment design
Cost analysis
A/B testing

Education

Bachelor’s/Master’s/PhD in CS/ML/EE

Tools

Multi-model APIs
Traffic replay
Shadow evaluation

Job description

Bitdeer AI Lab seeks a capable researcher to advance evaluation frameworks for agentic inference and LLM systems. You will own the evaluation pipeline, develop task suites, and study routing strategies while coordinating with MaaS and platform teams to deploy reliable, cost-aware solutions.

The role emphasizes rigorous experimentation, cross-disciplinary collaboration, and contribution to the cutting edge of AI-powered mining and cloud platforms.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Applied Scientist: Agent Evaluation & Adaptive Routing
Applied Scientist: Agent Evaluation & Adaptive Routing

Bitdeer • Austin (TX), Northern (KY)

Hybrid
USD 125,000 - 170,000
Mentoring program
Training opportunities
Competitive benefits
Adaptive AI Scientist: LLM Evaluation & Routing
Adaptive AI Scientist: LLM Evaluation & Routing

Bitdeer Technologies Group • Austin (TX)

On-site
USD 140,000 - 210,000
Applied Scientist, Agent Evaluation & Adaptive Model Routing
Applied Scientist, Agent Evaluation & Adaptive Model Routing

Bitdeer • Austin (TX), Northern (KY)

On-site
USD 125,000 - 170,000
Mentoring program
Training opportunities
Competitive benefits
Applied Scientist, Agent Evaluation & Adaptive Model Routing
Applied Scientist, Agent Evaluation & Adaptive Model Routing

Bitdeer (NASDAQ: BTDR) • Austin (TX)

On-site
USD 150,000 - 230,000
Diversity culture
Open workspaces
Fast-growing environment
+4
Applied Scientist, Agent Evaluation & Adaptive Model Routing
Applied Scientist, Agent Evaluation & Adaptive Model Routing

Bitdeer • Austin (TX), Northern (KY)

On-site
USD 125,000 - 170,000
Mentoring program
Training opportunities
Competitive benefits
Applied Scientist, Agent Evaluation & Adaptive Model Routing
Applied Scientist, Agent Evaluation & Adaptive Model Routing

Bitdeer Technologies Group • Austin (TX)

On-site
USD 140,000 - 210,000
Remote AI Agent Evaluation Engineer
Remote AI Agent Evaluation Engineer

EPAM Systems Inc • United States

Remote
USD 140,000 - 190,000
Research Scientist: Efficient AI Inference
Research Scientist: Efficient AI Inference

Bitdeer (NASDAQ: BTDR) • Austin (TX)

On-site
USD 140,000 - 220,000
LLM Agent Evaluation & Evolution Researcher
LLM Agent Evaluation & Evolution Researcher

Bytedance • San Jose (CA)

Hybrid
USD 180,000 - 240,000
Senior AI Engineer: Production LLM Agents & Inference
Senior AI Engineer: Production LLM Agents & Inference

Bitus Labs • Irvine (CA)

Hybrid
USD 140,000 - 190,000