Remote Python QA Lead & Quality Architect

YO IT Consulting

Auckland

On-site

NZD 55,104 - 96,432

Part time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

YO IT Consulting is seeking a Python Quality Assurance Lead for a remote hourly contractor role. You will oversee quality across Python AI training projects, review AI-generated Python code and trainer work, and provide precise feedback to ensure alignment with client rubrics.

You’ll spot recurring quality issues, update teams on guidelines, and help onboard contributors to maintain high standards. The ideal candidate has 3+ years in Python development and QA, strong English, and experience

Qualifications

  • Bachelor’s or Master’s degree in CS, SE, data science, or equivalent professional software experience.
  • Strong English to follow guidelines and provide clear feedback.
  • 3+ years in Python development, backend engineering, automation, QA, teaching or mentoring.
  • Solid Python fundamentals: data structures, functions, classes, modules, tests.
  • Ability to evaluate Python content against rubrics and identify issues.
  • Familiar with pytest/unittest, typing/mypy, tooling and frameworks.
  • Experience leading or supporting remote teams of trainers or QAs.
  • Comfort with Discord, Google Sheets/docs, trackers and dashboards.
  • Experience with AI training, data annotation or rubric-based code review is a plus.

Responsibilities

  • Spot-check Python items, identify quality issues, provide feedback.
  • Review AI-generated Python code, debugging, algorithms, tests and explanations.
  • Update trainers/QAs on Discord about guidelines and quality expectations.
  • Respond to questions on Python syntax, runtime behavior, exceptions, testing and security.
  • DM inactive contributors, track follow-ups, flag availability issues.
  • Create and maintain Python documentation, style guides, onboarding materials.
  • Run onboarding/training calls for Python contributors.
  • Flag insecure or non-production-ready Python recommendations.
  • Identify recurring quality gaps and improve Python QA workflows.

Skills

Python development
Quality assurance
Remote team leadership
Code review
Documentation writing

Education

Bachelor’s or Master’s degree in Computer Science, Software Engineering, Data Science, Information Technology, or equivalent

Tools

pytest
unittest
typing
mypy
pip
poetry
virtualenv
FastAPI
Flask
Django
requests
asyncio
pandas
SQLAlchemy
GitHub
Docker
CI/CD

Job description

YO IT Consulting is seeking a Python Quality Assurance Lead for a remote hourly contractor role. You will oversee quality across Python AI training projects, review AI-generated Python code and trainer work, and provide precise feedback to ensure alignment with client rubrics.

You’ll spot recurring quality issues, update teams on guidelines, and help onboard contributors to maintain high standards. The ideal candidate has 3+ years in Python development and QA, strong English, and experience

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Remote Psychology QA Lead for AI Training Quality
Remote Psychology QA Lead for AI Training Quality

YO IT Consulting • Auckland

On-site
Remote Hindi QA Lead for AI Data Training
Remote Hindi QA Lead for AI Data Training

YO IT Consulting • New Zealand

On-site
Remote SQL QA Lead - AI Data Quality & Training
Remote SQL QA Lead - AI Data Quality & Training

YO IT Consulting • Auckland

On-site
NZD 131,000 - 158,000
Remote Philosophy QA Lead (Contract)
Remote Philosophy QA Lead (Contract)

YO IT Consulting • Auckland

On-site
Senior Python Engineer - Remote AI Systems (Contract)
Senior Python Engineer - Remote AI Systems (Contract)

YO AI Labs • Alexandra

Remote
NZD 110,000 - 180,000
Remote Anthropology QA Lead for AI Training
Remote Anthropology QA Lead for AI Training

YO IT Consulting • Auckland

On-site
Remote Physics QA Lead for AI Training Quality
Remote Physics QA Lead for AI Training Quality

YO IT Consulting • Auckland

On-site
Remote Excel QA Lead — Data & Spreadsheet Quality
Remote Excel QA Lead — Data & Spreadsheet Quality

YO IT Consulting • New Zealand

On-site
NZD 60,000 - 80,000
Senior Python Software Engineer - Remote AI Training
Senior Python Software Engineer - Remote AI Training

YO AI Labs • Auckland

Remote
NZD 120,000 - 180,000
AI Training & Evaluation Lead (Remote)
AI Training & Evaluation Lead (Remote)

YO IT Consulting • Auckland

On-site
NZD 70,000 - 110,000