Senior LLM Evaluation Engineer & Metrics Architect

Binance

Singapore

Remote

SGD 120.000 - 180.000

Vollzeit

14 Tage+

Eine vollständige Bewerbung in einer Minute

Maßgeschneiderter Lebenslauf und Anschreiben – versandbereit.

Schaffe es an den ATS-Filtern vorbei

Benefits dieser Stelle

Remote-first, work-from-home arrange­m

Zusammenfassung

Binance is seeking an evaluation expert with an algorithmic background to build LLM evaluation capabilities across dialogue, financial trading, and other scenarios, using professional evaluation methods to quantify model performance and guide R&D.

You will design end-to-end evaluation plans, build datasets, and drive automation of evaluation workflows in a remote-first, Singapore-based team. Collaboration with algorithm, product, and data teams is essential.

Qualifikationen

  • Master's degree or above in Computer Science, AI, Mathematics, Statistics, or related fields.
  • Hands-on LLM evaluation experience at a large tech company.
  • Familiar with evaluation methods and their applicable boundaries.
  • Systematic control over evaluation data representativeness and result reliability.
  • Proficient in Python, with experience in evaluation workflow automation and data processing.
  • Strong business understanding and communication to translate evaluation findings into cross-team actions.

Aufgaben

  • Design end-to-end LLM evaluation plans for business scenarios such as dialogue and financial trading.
  • Lead the design and construction of evaluation datasets with high-quality annotation guidelines and informative benchmarks.
  • Analyze model capability boundaries and failure modes; produce actionable improvement recommendations for R&D teams.
  • Drive automation and scaling of evaluation workflows and build sustainable evaluation platforms.
  • Collaborate with algorithm, product, and data teams to translate business objectives into clear evaluation standards.

Kenntnisse

LLM evaluation
Data processing
Experiment design
Cross-team collaboration
Communication

Ausbildung

Master's degree or above in Computer Science, Artificial Intelligence, Mathematics, Statistics, or related fields

Tools

Python

Jobbeschreibung

Binance is seeking an evaluation expert with an algorithmic background to build LLM evaluation capabilities across dialogue, financial trading, and other scenarios, using professional evaluation methods to quantify model performance and guide R&D.

You will design end-to-end evaluation plans, build datasets, and drive automation of evaluation workflows in a remote-first, Singapore-based team. Collaboration with algorithm, product, and data teams is essential.

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Senior Evaluation Algorithm Engineer(APAC - Remote)
Senior Evaluation Algorithm Engineer(APAC - Remote)

Binance • Singapore

Remote
SGD 120.000 - 180.000
Remote-first, work-from-home arrange­m
LLM Evaluation Engineer – Benchmarking & Automation
LLM Evaluation Engineer – Benchmarking & Automation

UMELIFE (SINGAPORE) PTE. LTD. • Singapore

Vor Ort
SGD 120.000 - 180.000
Remote-First LLM Applied Data Scientist
Remote-First LLM Applied Data Scientist

Binance • Singapore

Remote
SGD 180.000 - 260.000
Remote-first policy
Competitive salary
Career development opportunities
LLM Evaluation Engineer: Benchmarking & Persona Testing
LLM Evaluation Engineer: Benchmarking & Persona Testing

KUAILU SOFTWARE (SINGAPORE) PTE. LTD. • Singapore

Vor Ort
SGD 70.000 - 120.000
Senior LLM Performance & Benchmark Engineer
Senior LLM Performance & Benchmark Engineer

Bitdeer Technologies Group • Singapore

Vor Ort
SGD 120.000 - 180.000
LLM Evaluation Engineer – Multilingual AI Metrics
LLM Evaluation Engineer – Multilingual AI Metrics

Nanyang Technological University • Singapore

Vor Ort
SGD 90.000 - 130.000
Remote LLM Data Scientist & AI Systems Engineer
Remote LLM Data Scientist & AI Systems Engineer

Binance • Singapore

Remote
SGD 90.000 - 150.000
Remote-first culture
Global team exposure
Competitive salary
Large Language Model (LLM) Evaluation Engineer
Large Language Model (LLM) Evaluation Engineer

KUAILU SOFTWARE (SINGAPORE) PTE. LTD. • Singapore

Vor Ort
SGD 70.000 - 120.000
LLM Data Scientist/Algorithm Engineer (Top Talent Program)
LLM Data Scientist/Algorithm Engineer (Top Talent Program)

Binance • Singapore

Remote
SGD 90.000 - 150.000
Remote-first culture
Global team exposure
Competitive salary
ML Engineer, LLM/VLM for Fintech Docs
ML Engineer, LLM/VLM for Fintech Docs

Monee Limited • Singapore

Vor Ort
SGD 120.000 - 180.000