Benchmark Scientist for Frontier AI Data & Evaluations

Kled AI; United States; Teletrabalho; USD 150 000 - 250 000; Tempo integral

Resumo da oferta

Kled AI is seeking a Research Scientist to design benchmarks and evaluations for image, video, and document models. You will build private test sets from opt-in data and run end-to-end experiments to quantify data value. You will craft human evaluation studies and publish trusted leaderboards for frontier AI labs.

Join a fast-moving team that translates benchmark results into data deals, collaborating closely with founders and lab buyers to advance data-driven AI training at scale.

Qualificações

• 3+ years ML research or research engineering experience.
• A benchmark or evaluation you built that other people actually used.
• Strong hands-on experience training and fine-tuning image or video models (PyTorch).
• Deep understanding of experimental design and statistics (controls, ablations, human studies).
• Experience running experiments end to end, from GPUs to final report.
• Clear writing for both researchers and buyers.

Responsabilidades

• Design and ship public benchmarks for image, video and document models.
• Build private test sets from real, opt-in data that no model has trained on.
• Run data-value experiments: train models with and without Kled data, measure changes.
• Design human evaluation studies and the automatic metrics that track them.
• Publish leaderboards and reports that researchers at frontier labs trust.
• Find where models fall short and tell our team what data to collect next.
• Work directly with the founders and lab buyers to turn results into data deals.

Conhecimentos

ML Research

Benchmarks

PyTorch

Experiment Design

Technical Writing

Ferramentas

PyTorch

Cloud GPUs

Descrição da oferta de emprego

Kled AI is seeking a Research Scientist to design benchmarks and evaluations for image, video, and document models. You will build private test sets from opt-in data and run end-to-end experiments to quantify data value. You will craft human evaluation studies and publish trusted leaderboards for frontier AI labs.

Join a fast-moving team that translates benchmark results into data deals, collaborating closely with founders and lab buyers to advance data-driven AI training at scale.