Senior Java Code Reviewer for Open-Source & LLM Testing

Softechub

San Mateo (CA)

On-site

USD 96,000 - 165,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Softechub in California seeks experienced software engineers at the tech lead level to contribute to this project with hands-on software engineering, including development environment automation, issue triaging, and evaluating test coverage and quality.

The role involves analyzing and triaging GitHub issues, setting up repositories with Docker, evaluating unit tests, and running/modifying real-world projects to assess LLM performance in bug-fixing scenarios, in collaboration with researchers.

Qualifications

  • 3+ years of overall software engineering experience.
  • Strong experience with Java or similar language.
  • Proficiency with Git, Docker, and basic software pipeline setup.
  • Ability to understand and navigate complex codebases.
  • Comfortable running, modifying, and testing real-world projects locally.
  • Experience contributing to or evaluating open-source projects is a plus.

Responsibilities

  • Analyze and triage GitHub issues across trending open-source libraries.
  • Set up and configure code repositories, including Dockerization and environment setup.
  • Evaluate unit test coverage and quality.
  • Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
  • Collaborate with researchers to identify repositories/issues challenging for LLMs.

Skills

Java
Codebase navigation

Tools

Git
Docker
CI/CD

Job description

Softechub in California seeks experienced software engineers at the tech lead level to contribute to this project with hands-on software engineering, including development environment automation, issue triaging, and evaluating test coverage and quality.

The role involves analyzing and triaging GitHub issues, setting up repositories with Docker, evaluating unit tests, and running/modifying real-world projects to assess LLM performance in bug-fixing scenarios, in collaboration with researchers.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Python Code Reviewer & Open-Source Evaluator
Senior Python Code Reviewer & Open-Source Evaluator

Softechub • San Mateo (CA)

On-site
USD 83,000 - 124,000
C/C++ Code Reviewer & Open-Source Quality Lead
C/C++ Code Reviewer & Open-Source Quality Lead

Softechub • San Mateo (CA)

On-site
USD 140,000 - 200,000
Senior JS Code Reviewer for Open-Source & LLM QA
Senior JS Code Reviewer for Open-Source & LLM QA

Turing Global India • United States

Remote
USD 25,000 - 30,000
Fully remote
Work on cutting-edge AI projects
Code Reviewer - Java (LATAM)
Code Reviewer - Java (LATAM)

Softechub • San Mateo (CA)

On-site
USD 96,000 - 165,000
Code Reviewer - C/C++ (LATAM)
Code Reviewer - C/C++ (LATAM)

Softechub • San Mateo (CA)

On-site
USD 140,000 - 200,000
Remote Freelance Python Code Reviewer & Triage
Remote Freelance Python Code Reviewer & Triage

Turing • United States

Remote
USD 34,000 - 55,000
Code Reviewer - Python (LATAM)
Code Reviewer - Python (LATAM)

Softechub • San Mateo (CA)

On-site
USD 83,000 - 124,000
Remote Open Source Code Reviewer
Remote Open Source Code Reviewer

Crossing Hurdles • United States

Remote
USD 80,000 - 120,000
C++ SWE Bench Engineer — Remote Open-Source & LLM Eval
C++ SWE Bench Engineer — Remote Open-Source & LLM Eval

Turing Global India • United States

Remote
USD 27,000 - 41,000
Fully remote
Cutting-edge AI projects
Remote JS Code Reviewer & Issue Triage Lead
Remote JS Code Reviewer & Issue Triage Lead

Turing • United States

Remote
USD 25,000 - 48,000
Remote work
Cutting-edge AI projects