Software Engineer - Evaluation Harness & Code Review

Terac; United States; Remote; USD 76,000 - 103,000; Full time

Job summary

Terac is conducting a remote study to benchmark coding environments used to evaluate AI agents. You will review realistic programming tasks and their evaluation harnesses to ensure they reflect real-world software engineering challenges.

During guided sessions you’ll explain your thought process aloud, participate in screen-sharing exercises, and provide feedback on logic, test cases, and overall environment design. Compensation is $65 per hour.

Qualifications

• Active professional experience as a software engineer.
• Hands-on experience building or maintaining test suites and evaluation harnesses.
• Comfortable reviewing code and explaining technical concepts aloud.
• Familiarity with complex real-world software architecture.

Responsibilities

• Review realistic programming tasks for accuracy and difficulty.
• Verify the logic and test cases within provided evaluation harnesses.
• Assess whether coding environments effectively measure software engineering skills.
• Walk us through your thought process while analyzing complex code structures.

Skills

Software engineering

Test suites

Evaluation harnesses

Code reviews

Communication

Job description

Terac is conducting a remote study to benchmark coding environments used to evaluate AI agents. You will review realistic programming tasks and their evaluation harnesses to ensure they reflect real-world software engineering challenges.

During guided sessions you’ll explain your thought process aloud, participate in screen-sharing exercises, and provide feedback on logic, test cases, and overall environment design. Compensation is $65 per hour.