Remote Java SWE Bench Engineer - LLM Code Evaluation

OpenTrain AI, Inc.

Argentina

Teletrabalho

ARS 42 624 000 - 85 248 000

Tempo parcial

Há 3 dias
Torna-te num dos primeiros candidatos

Uma candidatura completa num minuto

Currículo e carta de apresentação personalizados, prontos a enviar.

Ultrapassa os filtros ATS

Resumo da oferta

OpenTrain AI, Inc. is seeking a SWE Bench Engineer to evaluate Java code and measure how language models handle real bug-fixing tasks. You will run, modify, and review open-source projects locally to assess LLM performance.

This remote contractor role requires at least three years of software experience, strong Java, Git, Docker, and pipeline setup, plus professional English. The engagement is one month with 20+ hours per week.

Qualificações

  • At least three years of software engineering experience.
  • Strong hands-on Java experience.
  • Experience with Git, Docker and basic CI pipelines.
  • Ability to navigate complex codebases and run tests locally.
  • Professional fluency in English.

Responsabilidades

  • Analyze and triage issues in open-source Java libraries.
  • Set up repositories, Docker-based development environments, and basic software pipelines.
  • Review unit-test coverage and overall code quality.
  • Modify and run projects locally to evaluate LLM performance on bug-fixing tasks.
  • Find repositories and issues that create meaningful evaluation challenges for language models.
  • Work with researchers and, when needed, guide junior engineers on related projects.

Conhecimentos

Java
Git
Docker
Testing pipelines
Open-source familiarity

Ferramentas

Docker
CI pipelines

Descrição da oferta de emprego

OpenTrain AI, Inc. is seeking a SWE Bench Engineer to evaluate Java code and measure how language models handle real bug-fixing tasks. You will run, modify, and review open-source projects locally to assess LLM performance.

This remote contractor role requires at least three years of software experience, strong Java, Git, Docker, and pipeline setup, plus professional English. The engagement is one month with 20+ hours per week.

Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

SWE Bench Engineer (Java LLM Code Evaluation)
SWE Bench Engineer (Java LLM Code Evaluation)

OpenTrain AI, Inc. • Argentina

Teletrabalho
ARS 42 624 000 - 85 248 000
Remote Java LLM Code Evaluator (Part-Time Contractor)
Remote Java LLM Code Evaluator (Part-Time Contractor)

OpenTrain AI, Inc. • Argentina

Teletrabalho
ARS 35 141 000 - 70 281 000
Remote work
Java Developer | Remote | $25/hr
Java Developer | Remote | $25/hr

Crossing Hurdles • Argentina

Presencial
ARS 900 000 - 1 300 000
Remote AI Bug-Fix Evaluation Engineer (Open Source)
Remote AI Bug-Fix Evaluation Engineer (Open Source)

OpenTrain AI, Inc. • Argentina

Teletrabalho
ARS 127 871 000 - 277 054 000
Remote Rust SWE Bench Engineer for AI Bug-Fix Testing
Remote Rust SWE Bench Engineer for AI Bug-Fix Testing

OpenTrain AI, Inc. • Argentina

Teletrabalho
ARS 26 208 000 - 37 327 000
Remote JavaScript Code Reviewer for Open Source Projects
Remote JavaScript Code Reviewer for Open Source Projects

OpenTrain AI, Inc. • Argentina

Teletrabalho
ARS 127 871 000 - 277 054 000
SWE Bench Engineer C# Code Evaluation
SWE Bench Engineer C# Code Evaluation

OpenTrain AI, Inc. • Argentina

Teletrabalho
ARS 127 871 000 - 277 054 000
Remote Senior Software Engineer — Open-Source Task Evaluator
Remote Senior Software Engineer — Open-Source Task Evaluator

Anyone AI Inc. • Argentina

Teletrabalho
ARS 83 797 000 - 125 695 000
Remote work
Part-time, project-based consulting
SWE Bench Engineer (Rust)
SWE Bench Engineer (Rust)

OpenTrain AI, Inc. • Argentina

Teletrabalho
ARS 26 208 000 - 37 327 000
Remote Software Engineer, AI Code Review
Remote Software Engineer, AI Code Review

Contentu • Argentina

Teletrabalho
ARS 53 371 000 - 106 741 000
Principais localizações