Remote Python QA Lead for AI Training & Code Quality

AI Trainer Jobs; United States; Remote; USD 5,786,000 - 9,643,000; Full time

Job summary

AI Trainer Jobs is seeking a Python (Generalist) Quality Assurance Lead (QAL) for an hourly, remote contractor role. You will oversee quality, trainer performance, review AI-generated Python code, and ensure outputs align with project guidelines.

You will assess code correctness, runtime behavior, readability, and test coverage, provide precise written feedback, and help onboard new contributors. Selection includes an AI interview and a domain-specific task.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Software Engineering, Data Science, Information Technology, or equivalent.
• 3+ years of professional Python development, backend, automation, or QA experience.
• Strong English communication to follow guidelines and provide feedback.
• Familiarity with Python tooling and web frameworks is preferred.

Responsibilities

• Spot-check Python items, identify quality issues, and escalate recurring or critical issues.
• Review AI-generated Python code, debugging responses, algorithms, backend snippets, automation scripts, tests, and explanations.
• Update trainers/QAs on Discord about guidelines, workflow updates, and Python-specific quality expectations.
• Respond to questions around Python syntax, runtime behavior, exceptions, package usage, testing, typing, security, performance, and rubric interpretation.
• DM inactive contributors, encourage activation, track follow-ups, and flag availability issues.
• Create and maintain Python documentation, style guides, trackers, FAQs, examples, honeypots, and onboarding materials.
• Run onboarding/training calls for Python contributors.
• Flag misleading, non-executable, insecure, inefficient, or non-production-ready Python recommendations.
• Identify recurring quality gaps and improve Python QA workflows.

Skills

Python

AI Training

LLM evaluation

Code review

Debugging

Backend Development

Testing

Automation

Trainer Feedback

Python QA

Education

Bachelor’s or Master’s degree in Computer Science/Software Engineering/Data Science

Tools

pytest

unittest

typing

mypy

pip

poetry

virtualenv

FastAPI

Flask

Django

GitHub

Docker

CI/CD

Job description

AI Trainer Jobs is seeking a Python (Generalist) Quality Assurance Lead (QAL) for an hourly, remote contractor role. You will oversee quality, trainer performance, review AI-generated Python code, and ensure outputs align with project guidelines.

You will assess code correctness, runtime behavior, readability, and test coverage, provide precise written feedback, and help onboard new contributors. Selection includes an AI interview and a domain-specific task.