AI Code Evaluator (JavaScript) - RLHF Tasks, Contract

Biz Tech Consultants; United States; Remote; USD 83,000 - 152,000; Part time

Job summary

Biz Tech Consultants is seeking experienced software engineers to work on RLHF projects supporting AI coding agent training and evaluation. You will design realistic technical tasks or review and rate AI-generated responses for correctness and clarity.

The role emphasizes precise technical writing, quality review, and developing reliable evaluation methods for diverse projects, including remote or international collaboration.

Qualifications

• 4 to 7 years of experience building production systems.
• Strong hands-on skill in Javascript.
• Comfortable working with Docker and command line tools.
• Comfortable working with one relational and one NoSQL database.
• Can point to a clear before and after metric from past work.
• Experience working with remote or international clients or teams.
• Some exposure to secure data handling or compliance work.

Responsibilities

• Design technical tasks across areas such as software development, debugging, data processing, security, and ML; set up environments and tests when needed.
• Review AI-generated responses to assess correctness, code quality, and instruction adherence.
• Provide clear, evidence-based written feedback and comparative ratings across responses.
• Validate task or evaluation difficulty against AI model outputs and revise based on feedback.

Skills

Python

Java

JavaScript

Node.js

Go

Rust

Docker

Git

pytest

AI Integration

LLM

NoSQL

CI/CD

System Design

Tools

Kubernetes

Kafka

RabbitMQ

gRPC

Redis

Job description

Biz Tech Consultants is seeking experienced software engineers to work on RLHF projects supporting AI coding agent training and evaluation. You will design realistic technical tasks or review and rate AI-generated responses for correctness and clarity.

The role emphasizes precise technical writing, quality review, and developing reliable evaluation methods for diverse projects, including remote or international collaboration.