Data Annotator for ML Datasets & QA (Remote)

01.tech; Australia; A distancia; AUD 65.000 - 95.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Medical insurance

Annual benefits allowance

Professional training reimbursement

Relocation assistance

Corporate digital library

Psychologist sessions

Descripción de la vacante

01.tech is seeking a data annotation specialist to annotate unstructured data across chats, reviews, transcripts, and images. You will create guidelines, label taxonomies, and drive quality with LLM-assisted labeling and human-in-the-loop processes.

You will coordinate annotators, manage external vendors, and oversee datasets through lifecycle, ensuring privacy compliance. Remote-friendly environment with opportunities for growth.

Formación

• 1.5-2+ years of experience in data annotation or preparing datasets for ML.
• Hands-on with unstructured data: text, audio, images.
• Experience with annotation tools: Label Studio, CVAT, Prodigy, Doccano.
• Experience managing crowdsourcing platforms and annotation vendors.
• Experience using LLMs for data annotation and quality evaluation.
• Knowledge of inter-annotator agreement metrics (kappa, alpha, precision/recall).
• Python scripting and automation, Pandas, JSON/CSV/JSONL, API calls.
• SQL skills for querying and aggregating data.
• English proficiency at B2 level or above.

Responsabilidades

• Annotate unstructured data across support chats, inquiries, reviews, transcripts, and images.
• Develop annotation guidelines, label taxonomies, and edge-case instructions.
• Use LLMs for pre-labeling, automated quality evaluation, and synthetic data generation.
• Monitor annotation quality with inter-annotator metrics and gold sets.
• Coordinate annotators, calibration sessions, and provide feedback.
• Manage external annotation vendors and platforms, including SLAs and budgets.
• Manage datasets through lifecycle: versioning, splits, storage, documentation.
• Ensure data privacy and NDAs, access control for external vendors.
• Collaborate with Data Science and ML Eng teams to prioritize tasks.

Conocimientos

Data annotation

NLP labeling

QA and metrics

Project coordination

Herramientas

Label Studio

CVAT

Prodigy

Doccano

Descripción del empleo

01.tech is seeking a data annotation specialist to annotate unstructured data across chats, reviews, transcripts, and images. You will create guidelines, label taxonomies, and drive quality with LLM-assisted labeling and human-in-the-loop processes.

You will coordinate annotators, manage external vendors, and oversee datasets through lifecycle, ensuring privacy compliance. Remote-friendly environment with opportunities for growth.