Code Reviewer - Python

Careerflow.ai

United States

Remote

USD 28,000 - 40,000

Part time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Fully remote work

Job summary

Careerflow.ai is seeking experienced software engineers at a tech lead level to contribute to high-quality public GitHub repositories. The role involves hands-on development, environment automation, and issue triaging, with a focus on evaluating test coverage and LLM-driven bug-fixing scenarios.

You will analyze trending open-source projects, configure repositories with Dockerization, and work closely with researchers to identify challenging tasks for LLMs.

Qualifications

  • Minimum 3+ years of overall experience.
  • Strong experience with at least one of the following languages: Python
  • Proficiency with Git, Docker, and basic software pipeline setup.
  • Ability to understand and navigate complex codebases.
  • Comfortable running, modifying, and testing real-world projects locally.
  • Experience contributing to or evaluating open-source projects is a plus.

Responsibilities

  • Analyze and triage GitHub issues across trending open-source libraries.
  • Set up and configure code repositories, including Dockerization and environment setup.
  • Evaluating unit test coverage and quality.
  • Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
  • Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.

Skills

Python
Git
Docker
Codebase navigation
Testing

Tools

Git
Docker

Job description

About the Role: We are looking for experienced software engineers (tech lead level) who are familiar with high-quality public GitHub repositories and can contribute to this project. This role involves hands-on software engineering work, including development environment automation, issue triaging, and evaluating test coverage and quality

What does day-to-day look like

Analyze and triage GitHub issues across trending open-source libraries. Set up and configure code repositories, including Dockerization and environment setup. Evaluating unit test coverage and quality. Modify and run codebases locally to assess LLM performance in bug-fixing scenarios. Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.

Required Skills

Minimum 3+ years of overall experience

Strong experience with at least one of the following languages: Python

Proficiency with Git, Docker, and basic software pipeline setup.

Ability to understand and navigate complex codebases.

Comfortable running, modifying, and testing real-world projects locally.

Experience contributing to or evaluating open-source projects is a plus.

Nice to Have

Previous participation in LLM research or evaluation projects.

Experience building or testing developer tools or automation agents.

Perks of Freelancing With us

Work in a fully remote environment.

Opportunity to work on cutting-edge AI projects with leading LLM companies.

Offer Details

Commitments Required: Minimum 40 hours per week with overlap of 4 hours with PST.

Employment type : Contractor assignment (no medical/paid leave)

Duration of contract : 2-3 weeks.

Payment: $25 per approved task

Location : Argentina, Brazil, Chile, Colombia, Peru

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Code Reviewer - Java
Code Reviewer - Java

Careerflow.ai • United States

Remote
USD 41,000 - 50,000
Work fully remote
Work on cutting-edge AI projects with
Freelance contractor role
Code Reviewer - Golang
Code Reviewer - Golang

Careerflow.ai • United States

Remote
USD 34,000 - 83,000
Fully remote
Cutting-edge AI projects
Short-term contract
+1
Code Reviewer - C++/C# (LATAM)
Code Reviewer - C++/C# (LATAM)

Careerflow.ai • United States

Remote
USD 28,000 - 40,000
Fully remote
Work on cutting-edge AI projects
Code Reviewer - Javascript
Code Reviewer - Javascript

Careerflow.ai • United States

Remote
USD 83,000 - 165,000
Fully remote work
Work on cutting-edge AI projects
Code Reviewer - Python (LATAM)
Code Reviewer - Python (LATAM)

Softechub • San Mateo (CA)

On-site
USD 83,000 - 124,000
Code Reviewer - C/C++ (LATAM)
Code Reviewer - C/C++ (LATAM)

Softechub • San Mateo (CA)

On-site
USD 140,000 - 200,000
Code Reviewer - JavaScript
Code Reviewer - JavaScript

Turing Global India • United States

Remote
USD 25,000 - 30,000
Fully remote
Work on cutting-edge AI projects
Code Reviewer - Java (LATAM)
Code Reviewer - Java (LATAM)

Softechub • San Mateo (CA)

On-site
USD 96,000 - 165,000
Code Reviewer - Python
Code Reviewer - Python

Turing • United States

Remote
USD 34,000 - 55,000
Python
Python

Turing Global India • United States

Remote
USD 23,000 - 32,000
Work in a fully remote environment
Cutting-edge AI projects with leadingL