Data Annotator (Non-Coding)

Avance Consulting; South Africa; On-site; ZAR 83,000 - 152,000; Part time

Job summary

Avance Consulting seeks a hands-on Ubuntu desktop user to refine multimodal datasets for AI training. You will replay tasks in Ubuntu, capture screenshots, and create PyAutoGUI-style actions with precise annotations.

This is a GUI-driven, non-coding role focusing on accuracy and meticulous workflow replication. Responsibilities include navigating operating systems, following exact instructions, recording observations, and ensuring consistent, high-quality annotations.

Qualifications

• Hands-on experience using Ubuntu desktop environments.
• Strong attention to detail and patience for repetitive tasks.
• Ability to follow structured GUI annotation guidelines.

Responsibilities

• Navigate OS environments (Windows/macOS/Ubuntu) to complete tasks.
• Follow step-by-step instructions from the team.
• Observe system behavior and record actions and observations.
• Capture clear screenshots for each step in annotation tools.
• Flag any issues using predefined guidelines and maintain consistency.

Skills

Ubuntu desktop usage

Attention to detail

Patience

Annotation tooling

JSON writing

Tools

PyAutoGUI

Annotation tools

Screenshots capture

Job description

1 month (possibility to extend)
About the Role

We are looking for hands-on Ubuntu desktop users to help refine multimodal datasets for AI training.

This role involves replaying real computer tasks inside an Ubuntu environment, capturing accurate screenshots, and producing PyAutoGUI-style action annotations step-by-step.

This is not a coding or engineering role.

It requires excellent computer usage skills, patience, and strong attention to detail.

Responsibilities

Navigate and explore operating systems (e.g., Windows or macOS) to complete guided tasks.

Follow clear, step-by-step instructions provided by the team.

Observe how the system behaves when tasks are performed.

Record actions, results, and observations accurately in annotation tools.

Flag unexpected behavior or issues using predefined guidelines.

Maintain consistency and quality across repetitive tasks.

Requirements

1. Reconstruct GUI Task Trajectories

For each provided task:

Interpret the task instruction and text-only trajectory (Observation / Thought / Action).

Recreate the workflow inside an Ubuntu desktop environment.

At each step capture a clear screenshot of the current screen state.

Write the exact PyAutoGUI action JSON for the action taken next.

Update the thought and observation, likewise to your provided screenshot

2. Create New Tasks

3. Maintain Annotation Quality

Ensure screenshots match the correct UI state for each step.

Avoid impossible/inaccurate actions (wrong coordinates, inactive buttons, incorrect app state).

Follow consistent file naming and directory structure.

Must Have

You must be comfortable using Ubuntu Desktop as your primary or secondary OS, including:

File Manager

Desktop navigation, window switching, and settings

Understanding of basic file paths and user directories

Open-source Application Experience (Required)

You should know how to perform common tasks in:

Chrome

VLC Media Player

LibreOffice Writer / Calc / Impress

GIMP

VS Code

Annotation Accuracy.

Able to match screenshots with the correct next-step actions.

Able to identify UI elements and click at the correct coordinates.

Comfortable writing simple JSON.

Must be comfortable writing accurate screen-state descriptions (observations) and generating model-style thought processes that logically lead to the next action.

Patient, detail-oriented, consistent.

Able to follow structured guidelines.

Not easily bored by step-by-step GUI work.

What This Role Is Not

Not a programming job.

Not a research job.

Not a creative engineering role.

Not suitable for people who want only coding or high-level design work.

Not suitable for beginners who use only smartphones or Windows casually.

This is a precision-driven, GUI-based desktop annotation job.

Application Process:

Shortlisted candidates will be invited to complete an analytical challenge.