AI tester with German language

TSMG Holding; Warszawa; Remote; PLN 40,000 - 60,000; Full time

Job summary

A remote AI evaluation company is looking for a project evaluator to test and evaluate AI agents. Your responsibilities include generating requests and classifying responses to ensure the agents do not share harmful content. The role requires fluency in German and intermediate English, and offers full online training. Ideal candidates are tech-savvy and have good time management skills. Join to help create safer AI interactions.

Qualifications

• Must be fluent in German to communicate effectively.
• Ability to understand intermediate English for training.
• Demonstrate basic tech savviness in using AI tools.

Responsibilities

• Generate requests to the AI agent on assigned topics.
• Evaluate and classify responses generated by the AI.
• Meet daily performance targets.
• Communicate regularly with a supervisor.

Skills

Fluent German

Intermediate English

Basic tech savviness

Good time-management skills

High level of responsibility

Quick learner

Job description

Project Objective
This project aims to test and evaluate one AI agent in the development stage. By asking questions and requests, based on various categories (the training is provided), you will try to force the AI agent to say something harmful, offensive, dangerous or toxic and evaluate its responses.

The end goal is to prevent the AI agent from sharing any harmful, offensive, dangerous or toxic content to the end users and make it safer. This role is fully remote, full-time and has a duration of several months (depending on the project progress it might be prolonged). Full online training before the project will be provided.

Responsibilities

• Generate requests to the AI agent on the proposed topic.
• Evaluate the response proposed by the agent and classify it accordingly.
• Meet daily targets.
• Communicate with a supervisor.

Requirements

• Fluent German.
• Intermediate English (for training and internal communication with the team).
• Basic tech savviness.
• Good time-management skills.
• High level of responsibility.
• Quick learner.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.