Senior Python Engineer for AI Systems QA (Remote)

prolificacademicltd; United States; Remote; USD 41,000 - 69,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Job summary

Prolific Academic Ltd seeks a senior Python engineer to contribute expertise in training and evaluating AI systems. You will assess AI-generated Python, review algorithm explanations, and run scripts to verify behavior and performance.

The role focuses on clean, readable code and robust testing practices. Responsibilities include reviewing backend design, data pipelines, and APIs, and providing detailed feedback to improve model handling of software engineering problems.

Qualifications

• Bachelor’s degree in computer science, software engineering, or related field.
• Senior software engineer or developer experience with Python.
• Ability to solve medium to hard algorithmic problems in Python.
• Strong knowledge of Python internals: GIL, decorators, generators, memory management, async.
• High standards for modular, readable code and modern Python conventions.
• Careful review skills to spot logic, security, and resource-management issues.
• Experience with Python 3, type hints, and REST APIs (Django/FastAPI/Flask).
• Familiarity with testing tools like pytest or unittest.

Responsibilities

• Check AI-generated Python for correctness, readability, and maintainability.
• Review explanations of algorithmic solutions and identify gaps in reasoning.
• Run generated scripts to confirm behavior, outputs, and performance.
• Flag inefficient approaches, deprecated syntax, security issues, memory leaks.
• Provide feedback on backend design, data pipelines, and API development.
• Complete an initial skills assessment as part of joining the expert pool.

Skills

Python programming

Algorithmic problem solving

Code review

Memory management

Asynchronous programming

GIL knowledge

Education

Bachelor's degree in CS / Software engineering

Tools

Django

FastAPI

Flask

pytest

Job description

Prolific Academic Ltd seeks a senior Python engineer to contribute expertise in training and evaluating AI systems. You will assess AI-generated Python, review algorithm explanations, and run scripts to verify behavior and performance.

The role focuses on clean, readable code and robust testing practices. Responsibilities include reviewing backend design, data pipelines, and APIs, and providing detailed feedback to improve model handling of software engineering problems.