Role overview
Use senior Python engineering expertise to help assess and improve AI systems. After a short skills assessment, successful applicants can take paid tasks reviewing code and technical explanations, testing outputs, and providing structured feedback. Tasks are flexible, though some require an uninterrupted hour.
Responsibilities
- Check AI-generated Python code for correctness, readability, and sound engineering practice.
- Assess the logic behind algorithmic solutions and identify errors in explanations.
- Run generated scripts to verify their behavior, output, and performance.
- Flag inefficient approaches, outdated syntax, nonexistent library methods, security issues, and potential memory leaks.
- Give feedback on model reasoning about backend design, data pipelines, and APIs.
Requirements
- A bachelor’s degree or higher in computer science, software engineering, or a closely related technical field.
- Professional experience as a senior software engineer or developer specializing in Python.
- Ability to solve medium- to hard-level algorithm problems independently in Python.
- Strong knowledge of Python internals and features, including the GIL, decorators, generators, memory management, and asynchronous programming.
- Ability to write and assess modular, readable code following modern Python conventions.
- Careful review skills for spotting subtle logic and security defects.
Nice to have
- Experience with Django, FastAPI, or Flask; testing tools such as pytest, unittest, coverage.py, or tox; and REST or GraphQL APIs.
- Familiarity with Python 3 type hints and modern language features.
Benefits and work setup
- Paid assignments are reported to pay up to $50 per hour, depending on skills and experience; rates may vary by task.
- Work can be done remotely with flexible hours. Some tasks may be shorter, but applicants should be able to focus for an hour when required.