Remote AI Task Designer — Python, Linux, ML

Careerflow.ai; United States; Remote; USD 57,000 - 81,000; Full time

Benefits offered by this job

Paid per task

Free revision round

Flexible start date

Job summary

Careerflow.ai is seeking a hands-on developer to design and deploy hard, realistic tasks for evaluating AI agents on a Linux desktop. You will craft end-to-end scenarios and assemble the required data and files.

Responsibilities include writing clear agent instructions, building Python scripts to set up and score outcomes, testing tasks, and delivering brief documentation. This remote role offers a short-term contract with rapid onboarding and payment per task.

Qualifications

• Proficient in Python scripting and debugging real tasks.
• Familiar with AI coding tools and evaluating model outputs.
• Experience with Ubuntu and managing hosted Linux VMs.
• Strong attention to detail to avoid unclear instructions.
• Git version control basics.

Responsibilities

• Design realistic multi-step scenarios across applications.
• Assemble files needed: spreadsheets, documents, emails, data.
• Write the instruction for the AI agent: clear and complete.
• Write Python to set up the environment and score results automatically.
• Test tasks, run them, and provide concise documentation.

Skills

Python

Heavy AI user

AI/ML background

Ubuntu/Linux

Careful and detailed

Git basics

Job description

Careerflow.ai is seeking a hands-on developer to design and deploy hard, realistic tasks for evaluating AI agents on a Linux desktop. You will craft end-to-end scenarios and assemble the required data and files.

Responsibilities include writing clear agent instructions, building Python scripts to set up and score outcomes, testing tasks, and delivering brief documentation. This remote role offers a short-term contract with rapid onboarding and payment per task.