RLHF Strategist Expert (AI Community)

TELUS Digital; Turkey; Remote; TRY 1,365,000 - 3,412,000; Full time

Benefits offered by this job

Remote work

Flexible engagement

Global collaboration network

Job summary

TELUS Digital is seeking a role focused on designing multi-dimensional grading rubrics to evaluate AI responses for tone, logic, and instruction. You will lead QA audits on large annotation projects and refine the human-feedback loop for model learning.

The candidate will investigate AI hallucinations and craft prompt-engineering strategies, collaborating with stakeholders to define Ideal Response Profiles for diverse industries and user personas.

Qualifications

• Education: Bachelor’s degree in a technical or humanities field.
• English proficiency: minimum B1 level to draft rubrics.
• Language: native-level fluency in at least one language.
• Skills: exceptional writing and logic-based decision-making.

Responsibilities

• Conceptualize and draft multi-dimensional grading rubrics for AI responses.
• Lead QA audits for large-scale annotation projects to optimize feedback loops.
• Investigate hallucinations and logical fallacies; develop prompt-engineering strategies.
• Interface with stakeholders to define the Ideal Response Profile for industries or personas.

Skills

Exceptional writing and logic-based

Native-language fluency

Education

Bachelor’s degree (CS/AI/Data Science or Humanities)

Job description

At TELUS Digital, we use Reinforcement Learning from Human Feedback (RLHF) to align AI with human values, and in this role, you act as our "Logical Compass." We believe that AI should be helpful, honest, and harmless; you are the one who designs the strategies and rubrics to make that a reality. You will teach AI how to reason and how to maintain a consistent, helpful persona across different cultural contexts. At TELUS, you aren't just ranking data; you are defining the ethics of tomorrow’s AI.

Key Responsibilities:

• Conceptualize and draft multi-dimensional grading rubrics that evaluate AI responses for tone, logic, and instructional following.
• Lead quality-assurance audits for large-scale annotation projects, ensuring the human-feedback loop is optimized for model learning.
• Investigate complex "hallucinations" and logical fallacies in model outputs, developing prompt-engineering strategies to mitigate them.
• Interface with project stakeholders to define the "Ideal Response Profile" for specific industries or user personas.

Qualification path

Mandatory Qualifications:

• Education: Minimum of a Bachelor’s Degree (Technical (CS, AI, Data Science) or Humanities.
• English Proficiency: Minimum B1 (Intermediate) level English to draft project rubrics.
• Language: Native-level fluency in at least one language.
• Skills: Exceptional writing and logic-based decision-making.

Assessment:

In order to be hired into our community, you’ll go through a subject-specific qualification exam that will determine your suitability for the position and complete ID verification.

Payment:

Currently, pay rates for experts range from $20 - $50 USD per hour

Our Payment terms are defined for each project.

Why Join the TELUS Digital AI Community:

• Community Connection: Work remotely as part of a 1M+ diverse global AI Community of contributors and experts.
• Impactful Expertise: Use your native language and academic degree to shape real-world AI systems and products used by millions every day.
• Hands-on Innovation: Gain experience in the latest AI research, evaluation, and fine-tuning methodologies.
• Global Collaboration: Collaborate with a network of specialists across 20+ domains and 500+ languages and dialects.
• Flexible Engagement: Manage your own schedule while making a meaningful impact on the future of technology.

TELUS Digital AI Community

Our global AI Community is a vibrant network of more than one million contributors from diverse backgrounds who help customers collect, enhance, train, translate, and localize content to build better AI models. Become part of our growing community and contribute to the development of innovative AI technologies used by some of the world's largest brands.

Independent Contractor Relationship

This opportunity is offered on an independent contractor basis. Contributors have the flexibility to choose when and how much they work, subject to project availability and quality requirements. This opportunity is not and should not be construed as creating an employment relationship with TELUS Digital.