AI Evaluator - Typescript (Freelance Opportunity)

Biz Tech Consultants; United States; Remote; USD 83,000 - 165,000; Full time

Job summary

Biz Tech Consultants is seeking experienced software engineers for freelance RLHF projects that support AI coding agents. You will design technical tasks and review AI-generated responses for correctness and clarity.

Ideal candidates have 4–7 years in production systems, strong TypeScript/JavaScript skills, Docker experience, and familiarity with relational and NoSQL databases. Remote collaboration with international clients is expected.

Qualifications

• 4–7 years of experience building production systems.
• Strong hands-on skills in TypeScript and JavaScript.
• Experience with Docker.
• Experience with one relational and one NoSQL database.
• Able to show a clear before/after metric from past work.
• Experience working with remote or international clients or teams.
• Some exposure to secure data handling or compliance work.

Responsibilities

• Design technical tasks across software development, debugging, data processing, security, and ML.
• Review AI-generated responses for correctness and quality.
• Provide clear, evidence-based written feedback and ratings.
• Validate task difficulty against AI model outputs and revise as needed.

Skills

Typescript

JavaScript

Docker

Relational DB

NoSQL DB

Remote teams

Impact metrics

Job description

We are looking for experienced software engineers to work on a freelance basis on RLHF projects that support the training and evaluation of AI coding agents. Depending on the project, the work can involve designing realistic technical tasks, or reviewing and rating AI generated responses for correctness, clarity, and reliability. It suits engineers who enjoy precise technical writing and careful quality review as much as building.

Key Responsibilities

• Design technical tasks across areas such as software development, debugging, data processing, security, and machine learning, and set up any supporting environment and automated tests needed to validate them, where the project calls for task authoring.
• Review AI generated responses to technical tasks, assessing correctness, code quality, and adherence to instructions.
• Provide clear, evidence based written feedback and comparative ratings across responses.
• Validate task or evaluation difficulty against AI model outputs and revise based on review feedback.

Desired Candidate Profile

Highly Required

• 4 to 7 years of experience building production systems, not just internal tools.
• Strong hands on skill in Typescript, Javascript
• Comfortable with Docker.
• Comfortable working with one relational and one NoSQL database.
• Can point to a clear before and after metric from past work.
• Experience working with remote or international clients or teams.
• Some exposure to secure data handling or compliance work.

Preferred

• Has integrated an AI or LLM API into a real, shipped feature.
• Experience in AI training and evaluation work.

Employment Type Contractual/Freelance

• Key Skills Python, Java, JavaScript, Docker, AI Integration, Typescript