Senior Python Engineer, LLM Code Evaluation (US)

OpenTrain AI, Inc.; United States; Remote; USD 83,000 - 124,000; Part time

Benefits offered by this job

Remote work

Job summary

OpenTrain AI, Inc. is seeking a Senior Python Engineer to join an LLM code evaluation project. The role is remote, part-time, with a minimum of 20 hours per week and up to 40 hours as needed. You will review AI-generated code and provide clear, evidence-based feedback to improve model behavior.

Applicants should have strong Python expertise, experience with full-stack development, and a solid understanding of software architecture, debugging, and code review. U.S.-based candidates are preferred.

Qualifications

• Strong Python expertise across frameworks, tools and production practices.
• Experience building full-stack applications and deploying scalable software.
• Deep knowledge of software architecture, design, development, debugging, code quality, and code review.

Responsibilities

• Review AI-generated code and programming materials for an LLM evaluation project.
• Assess code quality and document evidence for judgments.
• Explain evaluations clearly to help improve model behavior.
• Keep reviews consistent and accurate across repeated tasks.

Skills

Python

Full-stack experience

Code review

Education

CS graduate from top universities

Tools

Git

CI/CD

Job description

Senior Python Engineer, LLM Code Evaluation

Review AI-generated code and programming examples, apply project guidelines, and explain your judgments. This U.S.-based role requires 20 or more hours per week and strong Python and software engineering skills.

Remote

Contract, part-time

The work

You will evaluate AI-generated code and programming materials for an LLM evaluation project. You will use project guidelines to make careful judgments and give clear feedback.

• Review source materials and model outputs against project guidelines.
• Assess code quality and document evidence for your judgments.
• Explain your evaluations clearly so the feedback can help improve model behavior.
• Keep your reviews consistent and accurate across repeated tasks.

What it pays and takes

• Pay: Compensation is handled through the project budget fields on the job page.
• Schedule: 20 or more hours per week, with the opportunity to work up to 40 hours per week.
• Location: Open to candidates in the United States.
• Language: Fluent in English, with strong written and spoken communication skills.
• Skills: Strong Python expertise, including frameworks, tools, and practices for building production software.
• Skills: Experience building full-stack applications and deploying scalable software.
• Skills: Deep knowledge of software architecture, design, development, debugging, code quality, and code review.
• Helpful background: Computer science graduates from Stanford, MIT, Carnegie Mellon, UC Berkeley, Georgia Tech, or comparable schools are welcome. Strong experience and skill matter more than school.

About AI training work

AI training uses examples and human reviews to help AI systems learn. Experienced engineers are paid to apply their software expertise and explain judgments that can help improve model outputs.