LLM Code Evaluation Engineer - Part-Time, Remote

OpenTrain AI, Inc.; United States; Remote; USD 83,000 - 165,000; Part time

Benefits offered by this job

Remote work

Flexible schedule

Job summary

OpenTrain AI, Inc. is seeking a Senior Software Engineer, LLM Evaluation (US-Based) to join as a part-time contractor.

The role focuses on evaluating AI-generated code, building training datasets, and creating checks that improve code quality across backend, frontend, API, and ML tasks. You will review AI-generated code for correctness, maintainability, and scalability, design automated checks, and collaborate with cross-functional teams on AI coding systems and evaluation.

Qualifications

• Experience evaluating AI-generated code.
• Proficiency in multiple programming languages including C/C++, Java, Rust and Go.
• Ability to deploy production-grade software.
• Clear written and spoken communication.

Responsibilities

• Create accurate code examples for backend, frontend, API, and ML tasks.
• Review AI-generated code for correctness, maintainability, scalability, and reliability.
• Assess software architecture, API design, production implementation, experimentation, monitoring, and maintenance.
• Build Python tools to verify code and create automated checks for code quality.

Skills

C/C++

Java

Rust

Go

Python

Code evaluation

Software architecture

Debugging

Job description

OpenTrain AI, Inc. is seeking a Senior Software Engineer, LLM Evaluation (US-Based) to join as a part-time contractor.

The role focuses on evaluating AI-generated code, building training datasets, and creating checks that improve code quality across backend, frontend, API, and ML tasks. You will review AI-generated code for correctness, maintainability, and scalability, design automated checks, and collaborate with cross-functional teams on AI coding systems and evaluation.