Data Generalist

Rex.zone; Sydney; Hybrid; AUD 90,000 - 120,000; Full time

Benefits offered by this job

Fully remote

Flexible schedule

Job summary

Rex.zone is hiring a senior remote data generalist in Australia to support AI/ML training pipelines through expert data labeling, RLHF, and QA evaluation. You will work on NLP and computer vision annotation tasks and help optimize prompts and evaluation metrics.

This fully remote role involves coordinating with annotation vendors and freelancers, enforcing strict labeling guidelines, and driving model improvements through thorough data quality checks and cross‑functional collaboration.

Qualifications

• Experience with large language model evaluation and model performance improvement.
• Ability to manage diverse annotation tasks across NLP and computer vision.
• Comfort working in a fully remote, cross-functional engineering environment.

Responsibilities

• Handle data labeling, RLHF, and QA evaluation for AI/ML training pipelines.
• Perform prompt evaluation and named entity recognition.
• Coordinate with annotation vendors and freelance experts to uphold quality standards.

Skills

Data labeling

NLP annotation

RLHF evaluation

QA evaluation

Job description

Discover full-time remote Data Generalist jobs in Sydney for 2026. Join Rex.zone to optimize AI/ML training pipelines through expert data labeling, RLHF, and QA evaluation.

Core Responsibilities in AI/ML Training Pipelines

As a senior remote data generalist, you will handle diverse tasks including RLHF (Reinforcement Learning from Human Feedback), complex data labeling, and comprehensive QA evaluation. Your daily workflows will involve prompt evaluation, named entity recognition, and content safety labeling across NLP and computer vision annotation projects. You will collaborate with annotation vendors and freelance experts to maintain high standards in LLM training pipelines.

Qualifications For Remote Data Generalists

We are looking for mid-senior professionals, though we occasionally offer entry-level and contract opportunities. Candidates must possess deep expertise in large language model evaluation and model performance improvement. You should be comfortable working in a fully remote environment, engaging with cross-functional engineering teams, and ensuring strict annotation guidelines compliance for diverse AI models.