JavaScript Software Engineer

Jointaro

United States

Remote

USD 74,000 - 105,000

Part time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Handshake is seeking motivated Software Engineers to evaluate Large Language Models (LLMs) in collaboration with top AI labs. This is a remote, part-time opportunity available to applicants located in the United States with eligible work authorization.

The role requires a commitment of 15+ hours per week, with pay starting at $65/hour and bonuses for task completion. Key responsibilities include developing and validating coding benchmarks by curating issues, solutions, and test suites from

Responsibilities

  • Develop and validate coding benchmarks by curating issues, solutions, and test suites from real-world repositories.
  • Ensure comprehensive unit and integration tests for solution verification.
  • Maintain consistency and scalability of benchmark task distribution.
  • Provide structured feedback on solution quality and debug/optimize benchmark code.
  • Document processes for reproducibility.

Job description

Handshake is seeking motivated Software Engineers to evaluate Large Language Models (LLMs) in collaboration with top AI labs.

Handshake AI projects are remote and part-time opportunities. Must be located in the US and have proper work authorization (OPT and H-1B not supported).

Key responsibilities include developing and validating coding benchmarks by curating issues, solutions, and test suites from real-world repositories, ensuring comprehensive unit and integration tests for solution verification, and maintaining the consistency and scalability of benchmark task distribution. You'll also provide structured feedback on solution quality, debug and optimize benchmark code, and document processes for reproducibility.

Shape the future of AI while building skills and confidence to navigate an AI-driven job market. This role will leverage your engineering expertise in a flexible environment, but you must be able to commit 15+ hours/week. Pay starts at $65/hour, plus bonuses for task completion.

Handshake isn't offering any visa sponsorship support at this time.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Remote Part-Time JS Engineer — AI Benchmarking & LLM QA
Remote Part-Time JS Engineer — AI Benchmarking & LLM QA

Jointaro • United States

On-site
USD 74,000 - 105,000
Python Software Engineer
Python Software Engineer

Jointaro • United States

Remote
USD 90,000 - 124,000
Remote Part-Time Python AI Engineer — LLM Benchmarking
Remote Part-Time Python AI Engineer — LLM Benchmarking

Jointaro • United States

On-site
USD 90,000 - 124,000
Computer Science Expert
Computer Science Expert

Handshake • United States

On-site
Remote AI Research Fellow — LLM Prompts & Domain Expertise
Remote AI Research Fellow — LLM Prompts & Domain Expertise

Handshake • United States

On-site
Remote Software Engineer: AI Code Evaluator (Contract)
Remote Software Engineer: AI Code Evaluator (Contract)

Handshake • United States

On-site
Senior Software Engineer, Handshake AI
Senior Software Engineer, Handshake AI

Handshake • San Francisco (CA)

On-site
USD 120,000 - 160,000
Equity in a fast-growing company
401(k) match
Flexible PTO
+2
Senior Software Engineer — AI Deployments & Customer Impact
Senior Software Engineer — AI Deployments & Customer Impact

Unknown Company • United States

On-site
USD 150,000 - 230,000
Equity
401(k) match
Parental benefits
+6
Strategic Projects Associate
Strategic Projects Associate

Cacheflow • San Francisco (CA)

On-site
USD 70,000 - 90,000
Equity in a fast-growing company
401(k) match
Paid parental leave
+2
Chemistry AI Research Fellow – Remote & Flexible Hours
Chemistry AI Research Fellow – Remote & Flexible Hours

Handshake • United States

On-site