Remote Part-Time Java Engineer — LLM Benchmarking

Handshake

United States

Remote

USD 73,873 - 105,214

Part time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Jointaro is seeking a motivated Java Software Engineer for part-time, remote opportunities to evaluate Large Language Models (LLMs). You will contribute to high-impact research by identifying gaps and explaining model failures while developing coding benchmarks reflecting real-world scenarios.

This role requires a commitment of 15+ hours per week and offers a competitive pay starting at $65/hour, plus bonuses for task completion. Candidates must be located in the US with proper work authorization.

Qualifications

  • Experience with software development using Java.
  • Strong understanding of unit and integration testing practices.
  • Ability to provide structured feedback and optimize code.

Responsibilities

  • Develop and validate coding benchmarks from real-world repositories.
  • Ensure comprehensive unit and integration tests for verification.
  • Maintain scalability of benchmark task distribution.
  • Provide feedback on solution quality and optimize benchmark code.
  • Document processes for reproducibility.

Skills

Java
Software Engineering
Unit Testing
Integration Testing

Job description

Jointaro is seeking a motivated Java Software Engineer for part-time, remote opportunities to evaluate Large Language Models (LLMs). You will contribute to high-impact research by identifying gaps and explaining model failures while developing coding benchmarks reflecting real-world scenarios.

This role requires a commitment of 15+ hours per week and offers a competitive pay starting at $65/hour, plus bonuses for task completion. Candidates must be located in the US with proper work authorization.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

LLM Java Developer
LLM Java Developer

AuraOne Human Data • United States

Remote
USD 83,000 - 152,000
Remote Part-Time JS Engineer — AI Benchmarking & LLM QA
Remote Part-Time JS Engineer — AI Benchmarking & LLM QA

Handshake • United States

On-site
USD 74,000 - 105,000
Remote Part-Time Python AI Engineer — LLM Benchmarking
Remote Part-Time Python AI Engineer — LLM Benchmarking

Handshake • United States

On-site
USD 90,000 - 124,000
Java Software Engineer | $25/hr Remote
Java Software Engineer | $25/hr Remote

Crossing Hurdles • United States

Remote
CLP 8,000,000 - 11,000,000
Remote Java Code Reviewer for LLM QA & Debugging
Remote Java Code Reviewer for LLM QA & Debugging

AuraOne Human Data • United States

Remote
USD 83,000 - 152,000
Senior Software Engineer - Remote LLM Eval
Senior Software Engineer - Remote LLM Eval

Turing • United States

Remote
USD 41,000 - 83,000
Fully remote
Remote Senior Java Code Reviewer for Open-Source & LLM QA
Remote Senior Java Code Reviewer for Open-Source & LLM QA

Careerflow.ai • United States

Remote
USD 41,000 - 50,000
Work fully remote
Work on cutting-edge AI projects with
Freelance contractor role
Remote Java Engineer - Open-Source & LLM Bug-Fix Lab
Remote Java Engineer - Open-Source & LLM Bug-Fix Lab

Crossing Hurdles • United States

Remote
CLP 8,000,000 - 11,000,000
Senior Software Engineer, LLM Evaluation (Remote)
Senior Software Engineer, LLM Evaluation (Remote)

AuraOne, Inc. • United States

Remote
USD 83,000 - 165,000
Remote Java AI Coding Specialist
Remote Java AI Coding Specialist

Remote • San Francisco (CA)

Remote
USD 11,000 - 90,000