Remote RLHF Strategy Architect

TELUS Digital AI Data Solutions; Australia; Remote; AUD 40,000 - 99,000; Full time

Benefits offered by this job

Remote work

Flexible engagement

Independent contractor basis

Global AI community

Job summary

TELUS Digital is seeking a Logical Compass to design evaluation rubrics and guide AI alignment. You will craft strategies to ensure helpful, honest, and harmless outputs across cultures, while shaping the ethics of tomorrow’s AI.

You’ll lead QA audits of large-scale annotation projects, investigate model hallucinations, and collaborate with stakeholders to define the Ideal Response Profile for industries and user personas. Remote, contractor role.

Qualifications

• Bachelor’s degree in a technical field or humanities.
• English proficiency at least B1.
• Native-level fluency in at least one language.
• Strong writing and logic-based decision-making.

Responsibilities

• Conceptualize and draft multi-dimensional grading rubrics that evaluate AI responses for tone, logic, and instructional following.
• Lead quality-assurance audits for large-scale annotation projects, ensuring the human-feedback loop is optimized for model learning.
• Investigate complex hallucinations and logical fallacies in model outputs, developing prompt-engineering strategies to mitigate them.
• Interface with project stakeholders to define the “Ideal Response Profile” for specific industries or user personas.

Skills

Writing

Logical reasoning

English proficiency

Education

Bachelor’s Degree (Technical or Humanities)

Job description

TELUS Digital is seeking a Logical Compass to design evaluation rubrics and guide AI alignment. You will craft strategies to ensure helpful, honest, and harmless outputs across cultures, while shaping the ethics of tomorrow’s AI.

You’ll lead QA audits of large-scale annotation projects, investigate model hallucinations, and collaborate with stakeholders to define the Ideal Response Profile for industries and user personas. Remote, contractor role.