Remote AI Generalist: LLM Evaluation & RLHF

Rex.zone; United States; Remote; USD 93,000 - 132,000; Full time

Job summary

Rex.zone is hiring a full-time AI Generalist for a remote position based in Cambridge. You will support LLM evaluation and model alignment, bridging engineering workflows with data labeling tasks, and work on RLHF and prompt evaluation to ensure high-quality training data.

The role suits mid-senior professionals with strong ML background, Python skills, and experience with data labeling and QA protocols, contributing to cutting-edge AI labs remotely.

Qualifications

• Background in machine learning and data operations.
• Proven experience in large language model evaluation, RLHF, and NLP.
• Familiarity with Python, data labeling platforms, and QA evaluation protocols.

Responsibilities

• Execute QA evaluation for generative AI outputs and guide evaluation pipelines.
• Perform named entity recognition and oversee annotation tasks including computer vision labeling.
• Collaborate with startups and annotation vendors to maintain training data quality and model alignment.

Skills

Machine learning

RLHF

NLP

Python

Data labeling

QA evaluation

Education

Bachelor's degree in CS or related field

Tools

Data labeling platforms

Job description

Rex.zone is hiring a full-time AI Generalist for a remote position based in Cambridge. You will support LLM evaluation and model alignment, bridging engineering workflows with data labeling tasks, and work on RLHF and prompt evaluation to ensure high-quality training data.

The role suits mid-senior professionals with strong ML background, Python skills, and experience with data labeling and QA protocols, contributing to cutting-edge AI labs remotely.