Senior Evaluation Algorithm Engineer (Fully Remote)

Binance; United States; Remote; USD 150,000 - 190,000; Full time

Job summary

Binance is seeking an experienced professional to design end-to-end LLM evaluation plans for business scenarios including dialogue and financial trading, and to build metrics that quantify model performance.

The role requires a Master's degree and hands-on LLM evaluation experience at a large tech company with deployment exposure. Bonus points for experience evaluating dialogue systems, RLHF, or reward models.

Qualifications

• Master's degree or higher in CS/AI with strong algorithms.
• Hands-on LLM evaluation experience at a large tech company with deployment exposure.

Responsibilities

• Design end-to-end LLM evaluation plans for dialogue and financial trading scenarios.
• Build evaluation metric systems and rubrics to quantify model performance and drive improvement.

Skills

LLM evaluation

Algorithmic foundations

Large-scale deployment experience

Education

Master's degree in CS/AI

Job description

• Design end-to-end LLM evaluation plans for business scenarios such as dialogue and financial trading.
• Build evaluation metric systems and rubrics to quantify model performance and drive improvement.

Requirements:

• Master's degree or above in Computer Science, AI, or related fields with a solid algorithmic foundation.
• Hands-on LLM evaluation experience at a large tech company with commercial deployment exposure.

Bonus Qualifications:

• Experience evaluating dialogue systems, AI Agents, or financial/trading LLMs.
• Familiarity with RLHF, reward models, or preference data-related work.

Why Binance:

• Shape the future with the world's leading blockchain ecosystem.
• Collaborate with world-class talent in a user-centric global organization with a flat structure.

Binance

Binance is a leading global blockchain ecosystem behind the world's largest cryptocurrency exchange by trading volume and registered users. Trusted by 300+ million people in 100+ countries, we offer a diverse range of digital-asset products and services.