Remote Part-Time Java Engineer — LLM Benchmarking

Jointaro; United States; On-site; USD 73,873 - 105,214; Part time

Job summary

Jointaro is seeking a motivated Java Software Engineer for part-time, remote opportunities to evaluate Large Language Models (LLMs). You will contribute to high-impact research by identifying gaps and explaining model failures while developing coding benchmarks reflecting real-world scenarios.

This role requires a commitment of 15+ hours per week and offers a competitive pay starting at $65/hour, plus bonuses for task completion. Candidates must be located in the US with proper work authorization.

Qualifications

• Experience with software development using Java.
• Strong understanding of unit and integration testing practices.
• Ability to provide structured feedback and optimize code.

Responsibilities

• Develop and validate coding benchmarks from real-world repositories.
• Ensure comprehensive unit and integration tests for verification.
• Maintain scalability of benchmark task distribution.
• Provide feedback on solution quality and optimize benchmark code.
• Document processes for reproducibility.

Skills

Java

Software Engineering

Unit Testing

Integration Testing

Job description

Jointaro is seeking a motivated Java Software Engineer for part-time, remote opportunities to evaluate Large Language Models (LLMs). You will contribute to high-impact research by identifying gaps and explaining model failures while developing coding benchmarks reflecting real-world scenarios.

This role requires a commitment of 15+ hours per week and offers a competitive pay starting at $65/hour, plus bonuses for task completion. Candidates must be located in the US with proper work authorization.