Senior LLM Evaluation Architect for Dialogue & Trading

Binance; United States; Remote; USD 150,000 - 190,000; Full time

Job summary

Binance is seeking an experienced professional to design end-to-end LLM evaluation plans for business scenarios including dialogue and financial trading, and to build metrics that quantify model performance.

The role requires a Master's degree and hands-on LLM evaluation experience at a large tech company with deployment exposure. Bonus points for experience evaluating dialogue systems, RLHF, or reward models.

Qualifications

• Master's degree or higher in CS/AI with strong algorithms.
• Hands-on LLM evaluation experience at a large tech company with deployment exposure.

Responsibilities

• Design end-to-end LLM evaluation plans for dialogue and financial trading scenarios.
• Build evaluation metric systems and rubrics to quantify model performance and drive improvement.

Skills

LLM evaluation

Algorithmic foundations

Large-scale deployment experience

Education

Master's degree in CS/AI

Job description

Binance is seeking an experienced professional to design end-to-end LLM evaluation plans for business scenarios including dialogue and financial trading, and to build metrics that quantify model performance.

The role requires a Master's degree and hands-on LLM evaluation experience at a large tech company with deployment exposure. Bonus points for experience evaluating dialogue systems, RLHF, or reward models.