Senior Software Engineer, LLM Code Evaluation (US-Based)

OpenTrain AI, Inc.; United States; Remoto; USD 83.000 - 165.000; Part-time

Descrizione del lavoro

OpenTrain AI, Inc. is seeking a Senior Software Engineer for LLM code evaluation. This US-based contract role focuses on reviewing AI-generated software, building Python agents, and verification tools for thorough evaluation of code from design to operations.

The position requires strong Python skills, experience with full-stack development, and the ability to produce clear explanations of evaluations. It is a remote, part-time engagement with a roughly 20+ hour weekly expectation.

Competenze

• Strong Python skills including production frameworks and tooling.
• Experience building full‑stack applications and deploying scalable software.
• Knowledge of software architecture, development, debugging and code review.

Mansioni

• Build Python agents and automated tools to find error patterns and check solutions.
• Assess model-generated code across prototyping, architecture, API design, production implementation, launching and operations.
• Develop AI coding solutions and evaluate them against performance benchmarks.
• Write clear, structured explanations for evaluations.

Conoscenze

Python

Full-stack

Software-architecture

Debugging

Code review

Descrizione del lavoro

Senior Software Engineer, LLM Code Evaluation (US-Based)

Review AI-generated software, build Python agents and verification tools, and assess code from design through operations. This US-based contract role calls for 20+ hours per week.

Remote

Contract, part-time

Engagement

Remote

Location

Posted

Open to applicants in

United States

The work

Create and refine code examples and software solutions for large language model training and benchmarking. Review AI-generated code and judge whether it is correct, efficient, scalable, reliable, and ready for production.

• Build Python agents and automated tools that find error patterns and check software solutions.
• Assess model-generated work across prototyping, architecture, API design, production implementation, launch, experimentation, monitoring, and ongoing operations.
• Help develop AI coding solutions and evaluate them against industry performance benchmarks.
• Write clear, structured explanations for your evaluations.

Time, location, and requirements

• Location: Open to candidates based in the United States.
• Time: At least 20 hours per week.
• Engagement: Part-time contractor role planned for one month, with possible extensions based on performance and fit.
• Bring strong Python skills, including knowledge of production frameworks, development tools, and best practices.
• Have experience building full-stack applications and deploying scalable software, with knowledge of software architecture, development, debugging, and code review.

About AI training work

AI training is the human work behind AI systems: people review examples and model answers so systems can learn from useful, accurate feedback. Software engineers bring the skills to assess generated code and build tools that check whether solutions work reliably.

Requirements

Job details

Location

100% remote

United States

Languages

Engagement

Contract, part-time

Coding & Software

Data type

Computer Code Programming

Computer Programming Coding, Evaluation Rating

Create and solve biology research problems, build Python analyses and models, and review scientific code for AI evaluation. Remote, flexible work averages about 15 hours weekly and pays $60 to $120 per hour equivalent, paid per task that meets project specifications.

Research vulnerabilities in private code repositories and turn findings into challenging AI security tasks. The role pays $100 per hour and requires at least 20 hours a week.

Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more

Create coding challenges and assess AI-generated software solutions for technical accuracy and good engineering practice. The role pays $40 to $60 per hour and requires at least 20 hours per week.

Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more

Build Python tools to verify code and assess AI-generated solutions across backend, data, machine learning infrastructure, and full-stack projects. This remote US contractor role calls for 20+ hours per week.

Evaluate AI-generated code, create solutions and Python checks, and assess software quality across several languages. This entry-level US-based contractor role requires 20+ hours a week and at least three years of software engineering experience.