Remote Python AI Code Reviewer & QA Specialist

Turing; United States; Remote; USD 21,000 - 34,000; Part time

Benefits offered by this job

Fully remote

Work on cutting-edge AI projects

Job summary

Turing is seeking experienced software engineers to review and rate AI-generated Python code for quality and performance. This freelance contractor role involves hands-on software engineering, including environment automation, issue triaging, and evaluating test coverage.

Remote work with collaboration alongside researchers to identify repositories and issues that challenge LLMs, helping advance AI tooling and evaluation workflows for frontier projects.

Qualifications

• Minimum 2+ years of overall experience.
• Strong Python experience.
• Proficiency with Git, Docker, and CI/CD basics.
• Ability to understand and navigate complex codebases.
• Experience contributing to or evaluating open-source projects is a plus.

Responsibilities

• Analyze and triage GitHub issues across trending open-source libraries.
• Set up and configure code repositories, including Dockerization and environment setup.
• Evaluating unit test coverage and quality.
• Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
• Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.

Skills

Python

Git

Docker

Code comprehension

Open-source experience

Tools

Git

Docker

Job description

Turing is seeking experienced software engineers to review and rate AI-generated Python code for quality and performance. This freelance contractor role involves hands-on software engineering, including environment automation, issue triaging, and evaluating test coverage.

Remote work with collaboration alongside researchers to identify repositories and issues that challenge LLMs, helping advance AI tooling and evaluation workflows for frontier projects.