Remote AI Engineer: RLHF & Evaluation Pipelines

Rex.zone; United States; On-site; USD 100,000 - 140,000; Full time

Job summary

Rex.zone is seeking a Mid-Senior Remote AI Engineer to enhance model quality and reliability for LLM and multimodal systems. This fully remote position involves building evaluation harnesses, integrating RLHF workflows, and collaborating with data operations. The role requires experience in shipping AI/ML systems, strong Python skills, and the ability to improve training data quality across NLP and computer vision applications.

Qualifications

• Mid-Senior experience shipping AI/ML systems in production.
• Strong Python skills and ability to build reliable data/evaluation pipelines.
• Hands-on experience with model evaluation and prompt evaluation.

Responsibilities

• Build and maintain LLM evaluation pipelines.
• Integrate RLHF signals and feedback loops.
• Define and iterate on annotation guidelines compliance checks.

Skills

Python

AI/ML systems

Model evaluation

Experiment design

Data labeling

Quality assurance

Job description

Rex.zone is seeking a Mid-Senior Remote AI Engineer to enhance model quality and reliability for LLM and multimodal systems. This fully remote position involves building evaluation harnesses, integrating RLHF workflows, and collaborating with data operations. The role requires experience in shipping AI/ML systems, strong Python skills, and the ability to improve training data quality across NLP and computer vision applications.