Senior Python Code Reviewer & Open-Source Evaluator

Softechub

San Mateo (CA)

On-site

USD 83,000 - 124,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Softechub in San Mateo, CA is seeking experienced software engineers at the tech‑lead level to contribute to a hands‑on project. You will automate development environments, triage issues, and evaluate test coverage as part of a research‑oriented effort.

Responsibilities include analyzing GitHub issues, Dockerizing repositories, and assessing unit tests while modifying code locally to gauge LLM bug‑fix performance, in collaboration with researchers to target challenging repositories.

Qualifications

  • Minimum 3+ years of overall software experience.
  • Strong Python proficiency.
  • Experience with Git and Docker; basic software pipeline setup.

Responsibilities

  • Analyze and triage GitHub issues across trending open-source libraries.
  • Set up and configure code repositories, including Dockerization and environment setup.
  • Evaluate unit test coverage and quality.
  • Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
  • Collaborate with researchers to identify repositories and issues challenging for LLMs.

Skills

Python
Git
Code navigation
CI/CD

Tools

Docker
CI/CD tooling

Job description

Softechub in San Mateo, CA is seeking experienced software engineers at the tech‑lead level to contribute to a hands‑on project. You will automate development environments, triage issues, and evaluate test coverage as part of a research‑oriented effort.

Responsibilities include analyzing GitHub issues, Dockerizing repositories, and assessing unit tests while modifying code locally to gauge LLM bug‑fix performance, in collaboration with researchers to target challenging repositories.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Java Code Reviewer for Open-Source & LLM Testing
Senior Java Code Reviewer for Open-Source & LLM Testing

Softechub • San Mateo (CA)

On-site
USD 96,000 - 165,000
C/C++ Code Reviewer & Open-Source Quality Lead
C/C++ Code Reviewer & Open-Source Quality Lead

Softechub • San Mateo (CA)

On-site
USD 140,000 - 200,000
Remote Freelance Python Code Reviewer & Triage
Remote Freelance Python Code Reviewer & Triage

Turing • United States

Remote
USD 34,000 - 55,000
Senior JS Code Reviewer for Open-Source & LLM QA
Senior JS Code Reviewer for Open-Source & LLM QA

Turing Global India • United States

Remote
USD 25,000 - 30,000
Fully remote
Work on cutting-edge AI projects
Code Reviewer - Python (LATAM)
Code Reviewer - Python (LATAM)

Softechub • San Mateo (CA)

On-site
USD 83,000 - 124,000
Remote Python Engineer: Open-Source QA & Automation Lead
Remote Python Engineer: Open-Source QA & Automation Lead

Turing Global India • United States

Remote
USD 23,000 - 32,000
Work in a fully remote environment
Cutting-edge AI projects with leadingL
Code Reviewer - C/C++ (LATAM)
Code Reviewer - C/C++ (LATAM)

Softechub • San Mateo (CA)

On-site
USD 140,000 - 200,000
Code Reviewer - Java (LATAM)
Code Reviewer - Java (LATAM)

Softechub • San Mateo (CA)

On-site
USD 96,000 - 165,000
Software Engineer (Open Source) | Remote
Software Engineer (Open Source) | Remote

Crossing Hurdles • United States

Remote
USD 80,000 - 120,000
Senior C# Engineer — Open-Source Vet & Docker/LLM Testing
Senior C# Engineer — Open-Source Vet & Docker/LLM Testing

Turing Global India • United States

Remote
USD 14,000 - 27,000
Fully remote
Cutting-edge AI projects