Remote AI Code Evaluation Engineer

Hire Feed; United States; Remote; USD 90,000 - 130,000; Full time

Job summary

Hire Feed is seeking a Software Engineer for AI Code Evaluation & Benchmarking. This remote role targets candidates in the United States and involves analyzing AI-generated code, validating solutions to software tasks, and ensuring correctness across environments.

The role emphasizes code review, debugging, and developing robust evaluation datasets and rubrics. A strong CS degree and 3+ years of software engineering experience are required.

Qualifications

• Bachelor’s or Master’s degree in computer science, software engineering, or a related technical field.
• 3 years of professional software engineering experience.
• Proficient in one or more programming languages such as Python, Java, C/C , Go, Swift, Objective-C, PHP, or SQL.

Responsibilities

• Review and evaluate AI-generated code for correctness, efficiency, maintainability, and adherence to requirements.
• Analyze software engineering tasks and validate whether proposed solutions meet expected outcomes.
• Debug code, reproduce issues, and verify fixes across different programming environments.
• Assess model-generated explanations, reasoning, and implementation approaches for technical accuracy.
• Create, refine, and maintain evaluation datasets, benchmarks, and grading rubrics for coding tasks.

Skills

Python

Java

C/C++

Go

Swift

Objective-C

PHP

SQL

Data structures

Algorithms

Debugging

Education

Bachelor’s or Master’s degree in CS or related field

Job description

Hire Feed is seeking a Software Engineer for AI Code Evaluation & Benchmarking. This remote role targets candidates in the United States and involves analyzing AI-generated code, validating solutions to software tasks, and ensuring correctness across environments.

The role emphasizes code review, debugging, and developing robust evaluation datasets and rubrics. A strong CS degree and 3+ years of software engineering experience are required.