Remote South Asia Software Engineers - Evaluation Study

AI Trainer Jobs; United States; Remote; USD 70,000 - 76,000; Full time

Job summary

AI Trainer Jobs is seeking experienced software engineers who can review coding tasks and evaluation harnesses for realism in a fully remote role. You will walk through proposed tasks, assess structure and difficulty, and provide actionable feedback to improve test suites.

Ideal candidates are based in South Asia with hands-on experience verifying realistic programming tasks in professional settings. This independent contractor position offers weekly payments on deliverables.

Qualifications

• Experience building or reviewing realistic programming tasks.
• Familiarity with evaluation harnesses or test automation.
• Based in South Asia.
• Able to discuss technical workflows in an interview setting.

Responsibilities

• Review proposed coding tasks and environments for realism.
• Provide technical feedback on structure and difficulty of evaluation harnesses.
• Walk through your approach to verifying complex code challenges.
• Suggest improvements to make test suites more robust.

Skills

Code review

Feedback

Technical writing

Job description

AI Trainer Jobs is seeking experienced software engineers who can review coding tasks and evaluation harnesses for realism in a fully remote role. You will walk through proposed tasks, assess structure and difficulty, and provide actionable feedback to improve test suites.

Ideal candidates are based in South Asia with hands-on experience verifying realistic programming tasks in professional settings. This independent contractor position offers weekly payments on deliverables.