Remote AI Research Engineer - RL & Model Evaluation

Appen Limited; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Appen Limited in the United States is seeking a research-focused team member to build reinforcement learning and agent environments for real customer and Frontier lab use cases, including task specifications, scoring, and evaluation.

You will develop benchmarks and evaluation harnesses to measure model and data quality across accuracy, robustness, safety, latency, and cost, and run fine-tuning, adapters, and other model experiments to evaluate how data and methods influence model behavior,

Responsibilities

• Build reinforcement learning and agent environments for real customer and Frontier lab use cases, including task specifications, scoring, and evaluation.
• Develop benchmarks and evaluation harnesses to measure model and data quality across accuracy, robustness, safety, latency, and cost.

Job description

Appen Limited in the United States is seeking a research-focused team member to build reinforcement learning and agent environments for real customer and Frontier lab use cases, including task specifications, scoring, and evaluation.

You will develop benchmarks and evaluation harnesses to measure model and data quality across accuracy, robustness, safety, latency, and cost, and run fine-tuning, adapters, and other model experiments to evaluate how data and methods influence model behavior,