SWE Bench Engineer C# Code Evaluation

OpenTrain AI, Inc.

Argentina

Remote

ARS 127,871,000 - 277,054,000

Part time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

OpenTrain AI, Inc. is seeking a remote contractor in Latin America to evaluate open-source repositories and assess how well LLMs handle bug-fixing tasks. You will configure environments, review tests, and work with researchers on challenging issues.

You must have 3+ years in software engineering, strong C# or C++, Git, and Docker skills, and be able to run and modify real-world projects locally. This short-term engagement supports four weeks with some overlap across time zones.

Qualifications

  • At least three years of software engineering experience.
  • Strong C# or C++ experience.
  • Experience with Git and Docker.
  • Ability to run, modify, and test real-world projects locally.
  • Familiarity with basic software pipeline setup.
  • Remote contractor in Latin America.

Responsibilities

  • Analyze and triage issues in open-source libraries.
  • Configure repositories and development environments, including Docker-based setups.
  • Review unit-test coverage and overall test quality.
  • Run, modify, and test real-world C# codebases locally.
  • Evaluate LLM performance on software bug-fixing tasks.
  • Help identify repositories and issues that challenge AI systems.

Skills

C#
C++
Git
Docker
CI/CD basics

Job description

You will evaluate open-source software repositories and examine how well large language models handle real bug-fixing tasks. The work combines software engineering, test review, environment setup, and hands-on code evaluation.

You will work with public GitHub repositories and collaborate with researchers to find issues and projects that are difficult for AI systems to solve.

  • Analyze and triage issues in open-source libraries.
  • Configure repositories and development environments, including Docker-based setups.
  • Review unit-test coverage and overall test quality.
  • Run, modify, and test real-world C# codebases locally.
  • Evaluate LLM performance on software bug-fixing tasks.
  • Help identify repositories and issues that challenge AI systems.
Requirements

This is a remote contractor assignment open to professionals in Latin America. The contract lasts four weeks, and the work includes four hours of overlap with Pacific Time.

  • Time: 20+ hours per week.
  • Experience: At least three years of software engineering experience.
  • Technical skills: Strong C# or C++ experience, Git, Docker, and basic software pipeline setup.
  • You must be able to run, modify, and test real-world projects locally.
  • LLM research, evaluation, developer tools, or automation-agent experience is an advantage.
  • Skills: C#, C++

Open to applicants in

  • Argentina
  • Belize
  • Bolivia
  • Chile
  • Colombia
  • Costa Rica
  • Dominican Republic
  • Guatemala
  • Honduras
  • Mexico
  • Panama
  • Paraguay
  • Uruguay
Preferred
  • Experience contributing to or evaluating open-source projects is helpful.

Complete coding-heavy AI training tasks involving machine learning models, Python, evaluation systems, and performance optimization. Work remotely for about 15 hours per week, with $60 to $120 per hour equivalent, paid per accepted task.

Create realistic bugs, features, refactoring, and performance tasks that test AI coding ability. This part-time contractor role pays $50 to $100 per hour equivalent, paid per task that meets project specifications.

Python3 JAVA Rust Algorithms Basics C++ Typescript

Work remotely on AI training projects involving Godot game development, gameplay systems, and technical reviews. Earn $70 to $130 per hour with flexible weekly hours over 1 to 3 months.

Build multi-step AI agents for mathematical research, turning proofs and technical material into reliable software systems. This remote contractor role is open across Latin America and pays $25 per approved task.

Evaluate AI coding tasks using real repository code, technical rubrics, and clear written feedback. The role pays $50 to $100 per hour equivalent, paid per task that meets the project specifications, for about 15 hours per week.

Python3 JAVA Rust Algorithms Basics C++ Typescript

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Code Reviewer (JavaScript) for Open-Source Repositories
Code Reviewer (JavaScript) for Open-Source Repositories

OpenTrain AI, Inc. • Argentina

Remote
ARS 127,871,000 - 277,054,000
ML/AI Systems Engineer
ML/AI Systems Engineer

OpenTrain AI, Inc. • Argentina

Remote
ARS 127,871,000 - 277,054,000
Remote work
SWE Bench Engineer (Rust)
SWE Bench Engineer (Rust)

OpenTrain AI, Inc. • Argentina

Remote
ARS 26,208,000 - 37,327,000
Backend Software Engineer for AI Coding Tasks
Backend Software Engineer for AI Coding Tasks

OpenTrain AI, Inc. • Argentina

Remote
ARS 106,620,000 - 213,241,000
Remote Software Engineer, AI Code Review
Remote Software Engineer, AI Code Review

Contentu • Argentina

Remote
ARS 53,371,000 - 106,741,000
Remote AI Bug-Fix Evaluation Engineer (Open Source)
Remote AI Bug-Fix Evaluation Engineer (Open Source)

OpenTrain AI, Inc. • Argentina

Remote
ARS 127,871,000 - 277,054,000
Senior Software Engineer, AI Training - Argentina
Senior Software Engineer, AI Training - Argentina

G2i Inc. • Argentina

Remote
ARS 209,054,000 - 418,107,000
Remote AI Coding Evaluator — Software Engineer (Contract)
Remote AI Coding Evaluator — Software Engineer (Contract)

Contentu • Argentina

Remote
ARS 53,371,000 - 106,741,000
Backend Developer (Argentina)
Backend Developer (Argentina)

Anyone AI Inc. • Argentina

Remote
ARS 125,695,000 - 251,391,000
LATAM Software Engineers: Coding Tasks for AI Evaluation
LATAM Software Engineers: Coding Tasks for AI Evaluation

Terac • Argentina

Remote
ARS 69,247,000 - 98,625,000
Hourly pay