Reviewer and rate AI-generated code-Python

Softechub

India

Remote

INR 827,000 - 1,653,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Softechub is seeking experienced software engineers at the tech lead level to contribute hands‑on to open‑source projects and internal targets. You will triage issues, configure repositories with Docker and environment scripts, and assess unit test coverage and quality.

You will modify and run code locally to gauge LLM performance in bug-fixing scenarios while collaborating with researchers to identify challenging repositories and issues for evaluation.

Qualifications

  • Minimum 2+ years of overall experience.
  • Strong experience with Python.
  • Proficiency with Git, Docker, and basic software pipeline setup.
  • Ability to understand and navigate complex codebases.
  • Comfortable running, modifying, and testing real-world projects locally.
  • Experience contributing to or evaluating open-source projects is a plus.

Responsibilities

  • Analyze and triage GitHub issues across trending open-source libraries.
  • Set up and configure code repositories, including Dockerization and environment setup.
  • Evaluating unit test coverage and quality.
  • Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
  • Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.

Skills

Python
Git
Docker
Software pipelines

Tools

Git
Docker

Job description

About

We are looking for experienced software engineers (tech lead level) who are familiar with high-quality public GitHub repositories and can contribute to this project. This role involves hands‑on software engineering work, including development environment automation, issue triaging, and evaluating test coverage and quality

Duties
  • Analyze and triage GitHub issues across trending open-source libraries
  • Set up and configure code repositories, including Dockerization and environment setup
  • Evaluating unit test coverage and quality
  • Modify and run codebases locally to assess LLM performance in bug-fixing scenarios
  • Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs
Required experience
  • Minimum 2+ years of overall experience
  • Strong experience with at least one of the following languages: Python
  • Proficiency with Git, Docker, and basic software pipeline setup
  • Ability to understand and navigate complex codebases
  • Comfortable running, modifying, and testing real-world projects locally
  • Experience contributing to or evaluating open-source projects is a plus
Nice to haves
  • Previous participation in LLM research or evaluation projects
  • Experience building or testing developer tools or automation agents

2-3 weeks

Hours

Minimum 40 hours per week with overlap of 4 hours with PST

Python

Proficiency with Git, Docker, and basic software pipeline setup

Ability to understand and navigate complex codebases

Comfortable running, modifying, and testing real-world projects locally

Experience contributing to or evaluating open-source projects is a plus

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Code Reviewer - Java
Code Reviewer - Java

Softechub • India

Remote
INR 3,271,000 - 4,579,000
LLM research experience
Developer tool automation
Code Reviewer - Javascript
Code Reviewer - Javascript

Be Additive Corporation • India

On-site
INR 1,500,000 - 2,500,000
Remote Python Engineer
Remote Python Engineer

Turing • Hyderabad

Remote
INR 3,726,600 - 6,211,001
Remote Python Engineer
Remote Python Engineer

Turing • Mumbai

Remote
INR 892,800 - 1,339,200
Remote Python Engineer
Remote Python Engineer

Turing • Hyderabad

Remote
INR 827,000 - 1,653,000
Remote Python Developer
Remote Python Developer

Turing • Pune District

Remote
INR 1,200,000 - 1,800,000
Remote Python Engineer
Remote Python Engineer

Turing • Pune District

Hybrid
INR 167,400 - 279,000
Remote Python Programmer
Remote Python Programmer

Turing • Dadri

Remote
INR 910 - 1,820
Flexible remote work environment
Opportunity to work on cutting-edge AI projects
Remote Python Developer
Remote Python Developer

Turing • Kolkata District

Remote
INR 2,484,400 - 4,968,800
Remote Python Programmer
Remote Python Programmer

Turing • India

Remote
INR 1,200,000 - 2,400,000
Fully remote environment
Work on cutting-edge AI projects