RL & Agentic AI Researcher — Benchmarking Data Quality

Protege

United States

On-site

USD 110,000 - 140,000

Full time

14 days+
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Protege is seeking a Machine Learning Researcher focused on reinforcement learning and agentic systems to evaluate and create datasets, tasks, and benchmarks for advanced AI systems.

The ideal candidate will have a strong machine learning background and experience in designing evaluation frameworks for real-world model behavior. Join us to help shape high-quality datasets that define AI performance.

Qualifications

  • PhD or equivalent Master's Degree + 4+ years industry experience in machine learning or related fields.
  • Experience with large, unstructured datasets used to train or evaluate ML systems.
  • Strong intuition for dataset quality and meaningful outcome structure.

Responsibilities

  • Design and build datasets, tasks, environments for benchmarking.
  • Develop frameworks to evaluate data quality for agentic systems.
  • Benchmark model behavior in RL and agentic settings.

Skills

Machine learning background
Reinforcement learning
Data evaluation
Experimental design
Problem-solving

Education

PhD or equivalent Master's Degree

Job description

Protege is seeking a Machine Learning Researcher focused on reinforcement learning and agentic systems to evaluate and create datasets, tasks, and benchmarks for advanced AI systems.

The ideal candidate will have a strong machine learning background and experience in designing evaluation frameworks for real-world model behavior. Join us to help shape high-quality datasets that define AI performance.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

ML Researcher: RL & Agentic Systems Benchmarking
ML Researcher: RL & Agentic Systems Benchmarking

Protege • New City (NY)

On-site
USD 120,000 - 160,000
Machine Learning Researcher, RL & Agentic Systems
Machine Learning Researcher, RL & Agentic Systems

Protege • United States

On-site
USD 110,000 - 140,000
Research Scientist, Agentic Data & Benchmarking
Research Scientist, Agentic Data & Benchmarking

Institute of Foundation Models • Sunnyvale (CA)

On-site
USD 180,000 - 250,000
Audio ML Researcher: Data Quality & Evaluation
Audio ML Researcher: Data Quality & Evaluation

Protege • United States

Remote
USD 100,000 - 150,000
Agentic Data Scientist & Benchmarking Researcher
Agentic Data Scientist & Benchmarking Researcher

Ifm Us • Sunnyvale (CA)

On-site
USD 180,000 - 240,000
Lead RL & Agentic AI Research—On-Device & Tools
Lead RL & Agentic AI Research—On-Device & Tools

Socket.dev • Cupertino (CA)

On-site
USD 220,000 - 320,000
Machine Learning Researcher - RL and Agentic
Machine Learning Researcher - RL and Agentic

Protege • New City (NY)

On-site
USD 120,000 - 160,000
Research Scientist, Data
Research Scientist, Data

Prophet Town • San Francisco (CA)

On-site
USD 120,000 - 160,000
Remote AI Benchmark & Datasets Engineer
Remote AI Benchmark & Datasets Engineer

Pathway Genomics Corporation • Palo Alto (CA)

Remote
USD 150,000 - 210,000
Intellectually stimulating work environment
Work with a pioneering AI startup
Flexible remote work options
Post-Training AI Research Engineer – RL & Agentic Infra
Post-Training AI Research Engineer – RL & Agentic Infra

Storm3 • San Francisco (CA)

On-site
USD 140,000 - 210,000
Medical Insurance
Dental Insurance
Vision Insurance
+2