Senior Software Engineer, LLM Evaluation (US-Based)

OpenTrain AI, Inc.; United States; Remote; USD 83,000 - 165,000; Part time

Benefits offered by this job

Remote work

Flexible schedule

Job summary

OpenTrain AI, Inc. is seeking a Senior Software Engineer, LLM Evaluation (US-Based) to join as a part-time contractor.

The role focuses on evaluating AI-generated code, building training datasets, and creating checks that improve code quality across backend, frontend, API, and ML tasks. You will review AI-generated code for correctness, maintainability, and scalability, design automated checks, and collaborate with cross-functional teams on AI coding systems and evaluation.

Qualifications

• Experience evaluating AI-generated code.
• Proficiency in multiple programming languages including C/C++, Java, Rust and Go.
• Ability to deploy production-grade software.
• Clear written and spoken communication.

Responsibilities

• Create accurate code examples for backend, frontend, API, and ML tasks.
• Review AI-generated code for correctness, maintainability, scalability, and reliability.
• Assess software architecture, API design, production implementation, experimentation, monitoring, and maintenance.
• Build Python tools to verify code and create automated checks for code quality.

Skills

C/C++

Java

Rust

Go

Python

Code evaluation

Software architecture

Debugging

Job description

Senior Software Engineer, LLM Evaluation (US-Based)

Evaluate AI-generated code, create training and benchmarking datasets, and build tools that check code quality. This US-based contractor role requires 20+ hours per week.

Remote

Contract, part-time

The work

You will help improve AI coding systems by creating, correcting, checking, and evaluating code. The work spans software development from design and prototyping through production use and ongoing maintenance.

• Create accurate code examples and solutions for backend, frontend, API, and machine learning tasks.
• Review AI-generated code for correctness, maintainability, scalability, and reliability.
• Assess software architecture, API design, production implementation, experimentation, monitoring, and maintenance.
• Build agents that check code quality and find recurring errors in full-stack applications.
• Design automated checks for software engineering tasks and contribute to performance benchmarks.
• Work with cross-functional teams on AI coding systems and evaluation.

Schedule and requirements

• Location: Open to candidates in the United States.
• Schedule: At least 20 hours per week; part-time contractor role.
• Experience deploying scalable, production-grade software using modern languages and tools.
• Knowledge of software architecture, design, development, debugging, and code-quality assessment.
• Clear spoken and written communication for explaining evaluation decisions.
• The work may also involve C/C++, Java, Rust, and Go.

About AI training work

AI training uses examples prepared and reviewed by people to help improve AI systems. Software engineers bring the judgment needed to assess code, and specialist projects may pay more for that expertise.

Create and solve biology research problems, build Python analyses and models, and review scientific code for AI evaluation. Remote, flexible work averages about 15 hours weekly and pays $60 to $120 per hour equivalent, paid per task that meets project specifications.

Research vulnerabilities in private code repositories and turn findings into challenging AI security tasks. The role pays $100 per hour and requires at least 20 hours a week.

Remote United Arab Emirates, Antigua and Barbuda, Albania +92 more

Create coding challenges and assess AI-generated software solutions for technical accuracy and good engineering practice. The role pays $40 to $60 per hour and requires at least 20 hours per week.

Remote United Arab Emirates, Antigua and Barbuda, Albania +92 more

Build Python tools to verify code and assess AI-generated solutions across backend, data, machine learning infrastructure, and full-stack projects. This remote US contractor role calls for 20+ hours per week.

Evaluate AI-generated code, create solutions and Python checks, and assess software quality across several languages. This entry-level US-based contractor role requires 20+ hours a week and at least three years of software engineering experience.