Remote Part-Time JS Engineer — AI Benchmarking & LLM QA

Handshake

United States

On-site

USD 74,000 - 105,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job description

Handshake is seeking motivated Software Engineers to evaluate Large Language Models (LLMs) in collaboration with top AI labs.

Handshake AI projects are remote and part-time opportunities. Must be located in the US and have proper work authorization (OPT and H-1B not supported).

Key responsibilities include developing and validating coding benchmarks by curating issues, solutions, and test suites from real-world repositories, ensuring comprehensive unit and integration tests for solution verification, and maintaining the consistency and scalability of benchmark task distribution. You'll also provide structured feedback on solution quality, debug and optimize benchmark code, and document processes for reproducibility.

Shape the future of AI while building skills and confidence to navigate an AI-driven job market. This role will leverage your engineering expertise in a flexible environment, but you must be able to commit 15+ hours/week. Pay starts at $65/hour, plus bonuses for task completion.

Handshake isn't offering any visa sponsorship support at this time.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

JavaScript Software Engineer
JavaScript Software Engineer

Handshake • United States

Remote
USD 74,000 - 105,000
Remote Part-Time Python AI Engineer — LLM Benchmarking
Remote Part-Time Python AI Engineer — LLM Benchmarking

Handshake • United States

On-site
USD 90,000 - 124,000
Python Software Engineer
Python Software Engineer

Handshake • United States

Remote
USD 90,000 - 124,000
Domain Expert, AI Evaluation (US)
Domain Expert, AI Evaluation (US)

Handshake • United States

Remote
USD 227,000 - 324,000
Remote Part-Time Software Engineer - AI Systems Reviewer
Remote Part-Time Software Engineer - AI Systems Reviewer

Handshake • United States

Remote
USD 136,000 - 194,000
Remote Part-Time Java Engineer — LLM Benchmarking
Remote Part-Time Java Engineer — LLM Benchmarking

Handshake • United States

Remote
USD 73,873 - 105,214
Software Engineer - AI Research & Evaluation (Remote)
Software Engineer - AI Research & Evaluation (Remote)

Handshake • United States

Remote
USD 50,000 - 83,000
AI QA Trainer - LLM Evaluation - Freelance Project
AI QA Trainer - LLM Evaluation - Freelance Project

Meridial • United States

Remote
USD 8,265 - 89,544
Secure computer and high-speed internet required
Senior Engineering Lead - AI Project Reviewer (Remote)
Senior Engineering Lead - AI Project Reviewer (Remote)

Handshake AI • United States

Remote
USD 96,000 - 138,000
Remote Technical SME & AI Benchmarking Engineer
Remote Technical SME & AI Benchmarking Engineer

Lilt, Inc. • United States

Remote
USD 83,000 - 165,000