Senior LLM Evaluation Engineer: Dialogue & Trading

Binance

Hongkong

Híbrido

AUD 140.000 - 210.000

Jornada completa

14 días+

Consigue una respuesta de este empleador

Tu currículum y tu carta de presentación, adaptados exactamente a lo que buscan contratar.

Supera los filtros ATS

Ventajas ofrecidas por este puesto de trabajo

Remote-first

Descripción de la vacante

Binance is seeking an evaluation expert to build LLM evaluation capabilities across dialogue, trading, and other scenarios. You will quantify model performance, identify issues, and drive model improvements through rigorous evaluation methods.

The role requires hands-on LLM evaluation experience at a major tech company, strong Python skills, and the ability to translate findings into actionable R&D directions within a fast-paced, remote-first environment.

Formación

  • Master’s degree or higher in Computer Science, AI, Mathematics or Statistics with solid algorithms background.
  • Hands-on LLM evaluation experience at a large tech company, incl. deployment evaluation.
  • Familiar with evaluation methods (human, model-based, metric computation) and boundaries.
  • Control over evaluation data representativeness, annotation consistency, and result reliability.
  • Proficient in Python, with experience in automation, benchmark construction or platform development.
  • Strong business understanding and communication skills for cross-team collaboration.

Responsabilidades

  • Design end-to-end LLM evaluation plans for dialogue and trading scenarios.
  • Lead dataset design, define evaluation dimensions, and build high-quality benchmarks.
  • Analyze capability boundaries and provide actionable improvement recommendations.
  • Automate and scale evaluation workflows and develop evaluation platforms.
  • Translate business goals into clear evaluation standards and drive R&D directions.

Conocimientos

Python
LLM evaluation
Cross-functional collaboration
Data analysis

Educación

Master's degree or above in CS/AI/Math/Stats

Herramientas

Python libraries for data processing
Evaluation platforms
Benchmarks

Descripción del empleo

Binance is seeking an evaluation expert to build LLM evaluation capabilities across dialogue, trading, and other scenarios. You will quantify model performance, identify issues, and drive model improvements through rigorous evaluation methods.

The role requires hands-on LLM evaluation experience at a major tech company, strong Python skills, and the ability to translate findings into actionable R&D directions within a fast-paced, remote-first environment.

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Senior Evaluation Algorithm Engineer(APAC - Remote)
Senior Evaluation Algorithm Engineer(APAC - Remote)

Binance • Hongkong

Híbrido
AUD 140.000 - 210.000
Remote-first
Remote LLM Data Scientist & AI Algorithm Engineer
Remote LLM Data Scientist & AI Algorithm Engineer

Binance • Hong Kong

A distancia
HKD 942.000 - 1.648.000
Remote-first, work-from-home
Competitive salary and benefits
Career growth and continuous learning
+1
AI Development Engineer Intern: Build Real LLM Features
AI Development Engineer Intern: Build Real LLM Features

Bybit Limited • Hong Kong

Presencial
HKD 350.000 - 700.000
Study Growth Fund
Internal Events
Global Collaboration
+2
AI Engineer Intern: LLM Prompts & Path to Full-Time
AI Engineer Intern: LLM Prompts & Path to Full-Time

Bybit Limited • Hong Kong

Presencial
HKD 100.000 - 134.000
Mentorship
Full-time offer after internship
LLM Data Scientist/Algorithm Engineer (Top Talent Program)
LLM Data Scientist/Algorithm Engineer (Top Talent Program)

Binance • Hong Kong

A distancia
HKD 942.000 - 1.648.000
Remote-first, work-from-home
Competitive salary and benefits
Career growth and continuous learning
+1
LLM Quality & Evaluation Engineer — Regional AI Center
LLM Quality & Evaluation Engineer — Regional AI Center

Argyll Scott • Hong Kong

Presencial
HKD 900.000 - 1.300.000
Contractor – AI Solution Developer for FinTech LLMs
Contractor – AI Solution Developer for FinTech LLMs

BOC International Holdings Ltd • Hong Kong

Presencial
HKD 300.000 - 540.000
AI Engineer, Trading Ops & Management
AI Engineer, Trading Ops & Management

crypto • Hong Kong

Presencial
HKD 900.000 - 1.200.000
Contractor - AI Solutions & LLM Deployment (FinTech)
Contractor - AI Solutions & LLM Deployment (FinTech)

BOC International • Hong Kong

Presencial
HKD 400.000 - 640.000
Founding LLM Engineer - Remote + 2% Equity
Founding LLM Engineer - Remote + 2% Equity

Ninja Management Limited • Hong Kong

A distancia
HKD 900.000 - 1.500.000
Equity 2%