Remote Part-Time JS Engineer — AI Benchmarking & LLM QA

Jointaro; United States; On-site; USD 74,000 - 105,000; Full time

Job description

Handshake is seeking motivated Software Engineers to evaluate Large Language Models (LLMs) in collaboration with top AI labs.

Handshake AI projects are remote and part-time opportunities. Must be located in the US and have proper work authorization (OPT and H-1B not supported).

Key responsibilities include developing and validating coding benchmarks by curating issues, solutions, and test suites from real-world repositories, ensuring comprehensive unit and integration tests for solution verification, and maintaining the consistency and scalability of benchmark task distribution. You'll also provide structured feedback on solution quality, debug and optimize benchmark code, and document processes for reproducibility.

Shape the future of AI while building skills and confidence to navigate an AI-driven job market. This role will leverage your engineering expertise in a flexible environment, but you must be able to commit 15+ hours/week. Pay starts at $65/hour, plus bonuses for task completion.

Handshake isn't offering any visa sponsorship support at this time.