ML Researcher: RL & Agentic Systems Benchmarking

Protege; New City (NY); On-site; USD 120,000 - 160,000; Full time

Job summary

Protege is looking for a Machine Learning Researcher in New York City to focus on reinforcement learning and agentic systems. This role involves defining and designing datasets and environments for benchmarking AI systems.

The ideal candidate will have a PhD or equivalent experience with 4+ years in machine learning, strong understanding of data quality, and experience in evaluation methodologies. Join our team and help shape the future of AI with high-quality datasets.

Qualifications

• 4+ years industry experience in ML, statistics, or engineering.
• Strong understanding of evaluation methodology and its role in model performance.
• Experience with large, unstructured datasets for training or evaluation.

Responsibilities

• Design datasets, tasks, and environments for benchmarking agentic systems.
• Develop frameworks assessing data quality across various dimensions.
• Evaluate model behavior in RL environments to identify issues.

Skills

Reinforcement Learning

Experimental Design

Data Validation

AI Model Training

Problem Solving

Education

PhD or equivalent Master's Degree

Job description

Protege is looking for a Machine Learning Researcher in New York City to focus on reinforcement learning and agentic systems. This role involves defining and designing datasets and environments for benchmarking AI systems.

The ideal candidate will have a PhD or equivalent experience with 4+ years in machine learning, strong understanding of data quality, and experience in evaluation methodologies. Join our team and help shape the future of AI with high-quality datasets.