Gameplay AI Evaluation Designer

OpenTrain AI, Inc.; United States; On-site; USD 60,000 - 90,000; Full time

Job summary

OpenTrain AI, Inc. is seeking a Game Development AI Evaluation Specialist to design small-scale game tasks and realistic bugs for AI evaluation. You will build interactive scenes, craft briefs, and define success criteria to guide automated testing.

You'll work with major engines (Unity, Godot, Unreal), create reference solutions, and perform end-to-end playtests to ensure tasks are reliable and solvable, strengthening freelance opportunities on the platform.

Qualifications

• Hands-on game development experience in AAA, indie, solo, or serious hobby projects.
• Public portfolio or published project required.
• Proficiency with Unity, Godot, or Unreal Engine including editor tools, scene management and debugging.
• Strong programming ability in C#, GDScript, C++, or Blueprints to inspect and improve gameplay logic.
• Experience writing task briefs and clear acceptance criteria.

Responsibilities

• Design small-scale game projects or interactive scenes in a major engine for assessment tasks.
• Integrate realistic gameplay bugs discoverable through playtesting and on-screen analysis.
• Develop feature challenges involving multiple gameplay systems and mechanics.
• Write concise briefs in the style of player, designer, or producer instructions.
• Create reference solutions covering bug fixes and feature implementations.
• Define success criteria using input sequences, expected visuals, and verifiable game states.
• Conduct end-to-end playtesting to ensure tasks are reliable and solvable.

Skills

Game development

Portfolio

Engines proficiency

Programming languages

Debugging tools

Tools

Unity

Godot

Unreal Engine

Job description

The work

You will create realistic game-development challenges for training and evaluating AI systems. The work combines hands-on game creation, debugging, playtesting, and writing clear evaluation instructions.

• Build small-scale projects and interactive scenes in Unity, Godot, or Unreal.
• Add realistic gameplay bugs that can be found and fixed through playtesting and on-screen analysis.
• Create feature challenges involving several gameplay systems and mechanics.
• Write concise briefs in the style of player, designer, or producer instructions.
• Create reference solutions for bug fixes and feature implementations.
• Define success criteria using input sequences, expected visual results, and verifiable game states.
• Playtest each task from start to finish to confirm it is reliable and solvable.

What it pays and takes

This is a part-time contractor role listed as entry level. You should already have practical game development experience and be able to show relevant work publicly.

• $25 to $70 per hour equivalent, paid per task that meets the project specifications.
• Part-time contract work with no weekly time requirement provided.
• Fluent in English.
• Open to candidates in the United Arab Emirates, Argentina, Austria, Bangladesh, Belgium, Bahrain, Brazil, Canada, Switzerland, Chile, Colombia, Germany, Denmark, Algeria, Egypt, Spain, France, the United Kingdom, Ghana, Greece, Indonesia, India, Italy, Jordan, Japan, Kenya, Kyrgyzstan, Kuwait, Kazakhstan, Lebanon, Sri Lanka, Morocco, Mexico, and Malaysia.
• Open to candidates in Nigeria, the Netherlands, Oman, Peru, the Philippines, Pakistan, Palestine, Portugal, Qatar, Saudi Arabia, Singapore, Thailand, Tunisia, Taiwan, the United States, Uzbekistan, Vietnam, and South Africa.
• Demonstrated game development experience in AAA, indie, solo, or serious hobby projects.
• A publicly viewable portfolio, published project, game jam entry, or shipped title.
• Advanced proficiency with Unity, Godot, or Unreal, including editor tools, scene management, and debugging utilities.
• Ability to use C#, GDScript, C++, or Blueprints to interpret, troubleshoot, and improve gameplay logic.
• Ability to identify and resolve gameplay issues through repeated playtesting and write precise task instructions and acceptance criteria.
• Experience in game QA, technical design, systems design, automated testing, or AI evaluation is helpful.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training is the human work behind systems that learn from examples, including game behavior, code, and model outputs. People with practical technical experience help create realistic examples and judge whether an AI system completes a task correctly.