SWE Bench Engineer (Java)

OpenTrain AI, Inc.

Argentina

Remote

ARS 35,141,000 - 70,281,000

Part time

13 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Remote work

Job summary

OpenTrain AI, Inc. is seeking a remote contractor to evaluate Java code produced for AI training. You will work with public Java repositories, GitHub issues, and unit tests, providing feedback that helps improve AI systems.

The duties include evaluating model outputs, reviewing source materials against guidelines, and explaining decisions clearly so feedback can drive improvements. Strong Java experience and English fluency are required, with a flexible, fully remote, part-time schedule.

Qualifications

  • At least 3 years of overall software experience, with Java focus.
  • Strong Java programming skills and ability to read and modify complex codebases.
  • English fluency for clear written and spoken communication.

Responsibilities

  • Evaluate Java code in public repositories and unit tests.
  • Review materials and model outputs against project guidelines.
  • Explain decisions clearly to enable improvements in AI systems.

Skills

Java experience
Code navigation
Open-source contribution
Review feedback

Tools

Git
Docker

Job description

Evaluate Java LLM code using public repositories, GitHub issues, and unit tests. This remote contractor project pays $25 per label and requires at least 20 hours per week.

$25/label

Contract, part-time

Remote

Open in 31 countries
  • Argentina
  • Bangladesh
  • Belize
  • Bolivia
  • Brazil
  • Chile
  • Colombia
  • Costa Rica
  • Dominican Republic
  • Ecuador
  • Egypt
  • El Salvador
  • Ghana
  • Guatemala
  • Guyana
  • Haiti
  • Honduras
  • India
  • Kenya
  • Mexico
  • Nicaragua
  • Nigeria
  • Pakistan
  • Panama
  • Paraguay
  • Peru
  • Puerto Rico
  • Suriname
  • Türkiye
  • Uruguay
  • Venezuela
The work

This role evaluates Java code produced or reviewed for large language models. You will work with public Java repositories, GitHub issues, and unit-test codebases, then provide clear feedback that helps improve AI systems.

The duties and qualifications below describe Java LLM code evaluation, so review them before applying.

  • Evaluate model outputs using project rubrics and record evidence-based judgments.
  • Review source materials and model outputs against project guidelines.
  • Explain your decisions clearly so feedback can improve model behavior.
  • Run, modify, and test real-world Java projects locally.
  • Maintain consistent, high-quality decisions across repeated review tasks.
What it pays and takes

This is a fully remote contractor assignment. The project is open to candidates in the countries listed below and requires English fluency.

  • Time: At least 20 hours per week.
  • Schedule: At least four hours per day and four hours of overlap with Pacific Standard Time.
  • Location: Open to candidates in Argentina, Bangladesh, Belize, Bolivia, Brazil, Chile, Colombia, Costa Rica, the Dominican Republic, Ecuador, Egypt, El Salvador, Ghana, Guatemala, Guyana, Haiti, Honduras, India, Kenya, Mexico, Nicaragua, Nigeria, Pakistan, Panama, Paraguay, Peru, Puerto Rico, Suriname, Türkiye, Uruguay, and Venezuela.
  • Experience: At least three years of overall experience; previous AI training experience is not required.
  • Technical skills: Strong Java experience, Git, Docker, basic software pipeline setup, and the ability to navigate complex codebases.
  • Helpful background: Open-source contribution or evaluation, LLM research or evaluation, or experience building or testing developer tools and automation agents.
About AI training work

AI training is the human work behind many artificial intelligence systems. Contributors review code, rate model answers, label data, and explain their judgments so AI systems can learn from reliable examples and expert feedback.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

SWE Bench Engineer C# Code Evaluation
SWE Bench Engineer C# Code Evaluation

OpenTrain AI, Inc. • Argentina

Remote
ARS 127,871,000 - 277,054,000
SWE Bench Engineer (Rust)
SWE Bench Engineer (Rust)

OpenTrain AI, Inc. • Argentina

Remote
ARS 26,208,000 - 37,327,000
SWE Bench Engineer (Java LLM Code Evaluation)
SWE Bench Engineer (Java LLM Code Evaluation)

OpenTrain AI, Inc. • Argentina

Remote
ARS 42,624,000 - 85,248,000
Backend Software Engineer for AI Coding Tasks
Backend Software Engineer for AI Coding Tasks

OpenTrain AI, Inc. • Argentina

Remote
ARS 106,620,000 - 213,241,000
Code Reviewer (JavaScript) for Open-Source Repositories
Code Reviewer (JavaScript) for Open-Source Repositories

OpenTrain AI, Inc. • Argentina

Remote
ARS 127,871,000 - 277,054,000
Remote Java LLM Code Evaluator (Part-Time Contractor)
Remote Java LLM Code Evaluator (Part-Time Contractor)

OpenTrain AI, Inc. • Argentina

Remote
ARS 35,141,000 - 70,281,000
Remote work
ML/AI Systems Engineer
ML/AI Systems Engineer

OpenTrain AI, Inc. • Argentina

Remote
ARS 127,871,000 - 277,054,000
Remote work
Senior Software Engineer, AI Training - Argentina
Senior Software Engineer, AI Training - Argentina

G2i Inc. • Argentina

Remote
ARS 209,054,000 - 418,107,000
Remote Software Engineer, AI Code Review
Remote Software Engineer, AI Code Review

Contentu • Argentina

Remote
ARS 53,371,000 - 106,741,000
Python Code Reviewer | $25/hr| Remote
Python Code Reviewer | $25/hr| Remote

Crossing Hurdles • Argentina

Remote
ARS 46,886,000 - 53,280,000