Senior Python/FastAPI Backend Engineer, AI Evaluation

OpenTrain AI, Inc.; United States; Remote; USD 55,000 - 165,000; Part time

Job summary

OpenTrain AI, Inc. is seeking a remote US contractor to review AI-generated Python code and build automated verification tools. The role focuses on Python backend services, data pipelines, and ML infrastructure, with cross-language collaboration on occasion.

The engagement is part-time, with 20+ hours per week, and a one-month initial term that can extend based on performance. You will evaluate code quality and contribute to production-ready solutions.

Qualifications

• At least three years of software engineering experience.
• Deep knowledge of Python and production engineering practices.
• Experience building full-stack applications and deploying scalable software.
• Strong ability to write clear evaluation reasoning.

Responsibilities

• Review and improve AI-generated code for efficiency, reliability, scalability, and production quality.
• Create clear code solutions and corrections, and curate examples for AI training projects.
• Build Python agents and automated checks that find error patterns and assess solution quality.
• Evaluate software work across prototyping, architecture, API design, implementation, launch, experimentation, monitoring, and maintenance.
• Work with teams across different functions to improve AI coding systems.

Skills

Python

Full-stack development

Software architecture

Code review

Production engineering practices

Job description

Review AI-generated Python code, build automated verification tools, and assess software quality in a remote US contractor role requiring 20+ hours a week.

Remote

Contract, part-time

Engagement

Remote

Location

Posted

Open to applicants in

United States

The work

Help create and refine software examples used to train and evaluate AI models. The role focuses on Python backend services, data pipelines, and machine learning infrastructure, with work across other programming languages as needed.

The role description centers on AI code evaluation, so review the duties and qualifications before applying.

• Review and improve AI-generated code for efficiency, reliability, scalability, and production quality.
• Create clear code solutions and corrections, and curate examples for AI training projects.
• Build Python agents and automated checks that find error patterns and assess solution quality.
• Evaluate software work across prototyping, architecture, API design, implementation, launch, experimentation, monitoring, and maintenance.
• Work with teams across different functions to improve AI coding systems.

What it takes

• Location: Remote, open to candidates based in the United States.
• Schedule: Flexible, with a commitment of 20 or more hours per week.
• Engagement: Contractor, part-time; the initial term is one month, with possible extensions based on performance and fit.
• At least three years of software engineering experience and deep knowledge of Python, its frameworks and tools, and production engineering practices.
• Experience building full-stack applications and deploying software that can scale.
• Strong skills in software architecture, design, development, debugging, and code review.
• Ability to write and explain clear, well-organized evaluation reasoning.

About AI training work

AI training work is the human work of preparing examples and reviewing outputs that help AI systems learn. Software engineers are paid for applying their coding expertise to assess, correct, and explain code that can be used to train and evaluate models.

Create and solve biology research problems, build Python analyses and models, and review scientific code for AI evaluation. Remote, flexible work averages about 15 hours weekly and pays $60 to $120 per hour equivalent, paid per task that meets project specifications.

Research vulnerabilities in private code repositories and turn findings into challenging AI security tasks. The role pays $100 per hour and requires at least 20 hours a week.

Create coding challenges and assess AI-generated software solutions for technical accuracy and good engineering practice. The role pays $40 to $60 per hour and requires at least 20 hours per week.

Build Python tools to verify code and assess AI-generated solutions across backend, data, machine learning infrastructure, and full-stack projects. This remote US contractor role calls for 20+ hours per week.

Evaluate AI-generated code, create solutions and Python checks, and assess software quality across several languages. This entry-level US-based contractor role requires 20+ hours a week and at least three years of software engineering experience.