Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
Careerflow.ai is hiring an AI Engineer to craft challenging RL-based task environments for testing AI agents on a Linux desktop.
You will design scenarios, assemble data, write agent instructions, and implement scoring in Python. This contract role is fully remote from India with a 3–4 week window and a per-task compensation of $50. Start next day after selection and collaborate asynchronously with a fast-moving team.
Home · Careerflow.ai · AI Engineer / AI Software Engineer-Task Creator (RL Environments) (Contract)
Careerflow Human Data Labs partners with AI companies to bring real-world professional expertise into their products.
We build hard, realistic tasks used to test how well AI agents do real work on a computer. Each task is a small scenario running on a Linux desktop — real files, real applications, real documents — plus a program that automatically checks whatever the agent produced.
You create those tasks end to end. The bar: hard for a top AI agent, straightforward for a competent human.
Short application → the screening questions below → a quick call → one paid pilot task ($50 on acceptance) → onboard. Decisions within 48 hours.
Short-term contract, 3 to 4 weeks
Immediately — the day after selection
Fully remote, India Only
Flexible — we measure delivered tasks, not hours