Applied AI Research Engineer (Fully Remote)

Appen Limited; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Appen Limited in the United States is seeking a research-focused team member to build reinforcement learning and agent environments for real customer and Frontier lab use cases, including task specifications, scoring, and evaluation.

You will develop benchmarks and evaluation harnesses to measure model and data quality across accuracy, robustness, safety, latency, and cost, and run fine-tuning, adapters, and other model experiments to evaluate how data and methods influence model behavior,

Responsibilities

• Build reinforcement learning and agent environments for real customer and Frontier lab use cases, including task specifications, scoring, and evaluation.
• Develop benchmarks and evaluation harnesses to measure model and data quality across accuracy, robustness, safety, latency, and cost.

Job description

• Build reinforcement learning and agent environments for real customer and Frontier lab use cases, including task specifications, scoring, and evaluation.
• Develop benchmarks and evaluation harnesses to measure model and data quality across accuracy, robustness, safety, latency, and cost.
• Run fine-tuning, adapter, and other model experiments to evaluate how data and methods influence model behavior, and deploy local or self-hosted models for evaluation and inference.