Senior Python Engineer - AI Eval & Code Quality (Remote)

prolificacademicltd; United States; Remote; USD 57,000 - 81,000; Full time

Benefits offered by this job

Remote work

Flexible tasks

Competitive hourly pay up to $50

Job summary

prolificacademicltd is seeking a Senior Python expert to contribute to the training and evaluation of AI systems. You will review generated Python code for correctness, explain algorithm validity, run verification scripts, and provide structured feedback to improve model performance.

A short skills assessment is required before joining the expert network. The role emphasizes modular, readable Python with familiarity of GIL, decorators, generators, memory management, and asynchronous programming.

Qualifications

• Bachelor's degree or higher in computer science, software engineering, or a closely related technical discipline.
• Professional experience as a senior software engineer or developer specializing in Python.
• Ability to solve medium- to hard-level algorithm problems independently in Python.
• Strong knowledge of Python internals and features, including the GIL, decorators, generators, memory management, and asynchronous programming.
• High standards for modular, readable code and familiarity with Python conventions such as PEP 8 and PEP 20.
• Careful review skills, including the ability to identify logic errors, memory leaks, and security issues.

Responsibilities

• Review generated Python code for correctness, readability, and sound engineering practices.
• Check whether algorithm explanations are logically valid and identify gaps in their reasoning.
• Run scripts to verify their outputs and assess performance.
• Flag inefficient approaches, outdated syntax, and incorrect claims about libraries.
• Provide feedback on model responses about backend architecture, data pipelines, and API design.
• Help assess or summarize complex scientific material as part of AI training tasks.

Skills

Python expertise

Algorithm problem solving

Code review

Python internals

Education

Bachelor's degree in CS/SE

Tools

Django

FastAPI

Flask

pytest

unittest

REST/GraphQL APIs

Job description

prolificacademicltd is seeking a Senior Python expert to contribute to the training and evaluation of AI systems. You will review generated Python code for correctness, explain algorithm validity, run verification scripts, and provide structured feedback to improve model performance.

A short skills assessment is required before joining the expert network. The role emphasizes modular, readable Python with familiarity of GIL, decorators, generators, memory management, and asynchronous programming.