Full-Stack Code Output Evaluator

Claru; United States; Presencial; USD 76.000 - 138.000; Jornada completa

Descripción de la vacante

AI Trainer Jobs is hiring a senior reviewer to assess AI-generated code across JavaScript, TypeScript, Java backend services, and Node.js APIs. You will run code in a sandbox or local environment, verify it works as specified, and score it on multiple rubric dimensions.

The role requires 4+ years of professional full-stack development experience and production-level fluency in JavaScript/TypeScript and Java. Strong focus on security and PR quality is essential.

Formación

• 4+ years of professional full-stack development experience.
• Production-level fluency in JavaScript/TypeScript and Java.
• Experience reviewing code and PRs in a senior/lead capacity.

Responsabilidades

• Review AI-generated code across the full web stack.
• Run code in a sandbox or local environment to verify functionality.
• Score code on correctness, security, maintainability, and adherence to task specifications.
• Document issues with line-level references.
• Evaluate backend architectures for Node.js or Java services.

Conocimientos

JavaScript/TypeScript

Java backend

Node.js API

Security vulnerabilities

Code review

Descripción del empleo

Pay: $55-100/hour

You'll review AI-generated code across the full web stack — JavaScript, TypeScript, Java backend services, and Node.js APIs — assessing correctness, security, maintainability, and adherence to the task specification. For each task, you receive a prompt that was given to a code-generating model and the code it produced. You run the code (in a provided sandbox or your local environment), verify it works as specified, and score it on multiple rubric dimensions. If the code is broken or insecure, you document exactly why, with line-level references.

Workflows include side-by-side comparison tasks (picking the better of two model outputs with written justification), single-output correctness reviews (does this code do what the prompt asked?), and security-flag tasks (does this output introduce SQL injection, XSS, or insecure dependency patterns?). You'll also encounter backend architecture tasks where you evaluate whether a Node.js or Java service is structured sensibly for the stated use case — not just whether it runs, but whether a senior engineer would accept it in a real PR. Some tasks use Eclipse-based Java projects; comfort navigating that toolchain is expected.

You should have at least 4 years of professional full-stack development experience, with production-level fluency in JavaScript/TypeScript and Java. You don't need to write new features — your job is to read and judge code quickly and accurately. Annotators who've done code review as part of a senior or lead engineering role tend to calibrate well for this work.

Skills & requirements

• JavaScript and TypeScript proficiency
• Java backend development
• Node.js API architecture
• Security vulnerability identification
• Code review and pull request evaluation

Category: Coding Review