Software Engineer, AI Research and Code Evaluation

OpenTrain AI, Inc.

United States

Remote

USD 55,000 - 165,000

Part time

1 hour ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

OpenTrain AI, Inc. seeks a Software Engineer for AI Research and Code Evaluation. This remote, US-based contractor role requires 20+ hours per week and an initial one-month term, with potential extensions.

You will evaluate AI-generated code across backend, frontend, API, and ML components, and build tools that verify solutions. You will craft automated checks, assess software quality, and contribute to datasets used to train and benchmark models.

Qualifications

  • Experience deploying scalable, production-grade software.
  • Strong understanding of software architecture, development, debugging, and code review.
  • Clear, structured communication of technical evaluations.

Responsibilities

  • Evaluate backend, frontend, API, and ML code for quality and performance.
  • Build agents to identify error patterns and verify solutions.
  • Assess AI capabilities in software architecture, API design, production implementation, monitoring and maintenance.
  • Design automated checks that test solutions to software engineering tasks.

Skills

Code evaluation
Software design
Debugging
Communication

Job description

Software Engineer, AI Research and Code Evaluation

Evaluate AI-generated code across full-stack applications, correct software examples, and build tools that verify solutions. This US-based contractor role requires 20+ hours per week.

Remote

Contract, part-time

The work

Help create datasets used to train and benchmark large language models by curating code examples, writing solutions, correcting implementations, and assessing AI-generated software.

  • Evaluate backend, frontend, API, and machine learning code for quality and performance.
  • Build agents to find error patterns and check software solutions.
  • Assess AI capabilities in software architecture, API design, production implementation, monitoring, and maintenance.
  • Design automated checks that test solutions to software engineering tasks.
What it takes
  • Have experience deploying scalable, production-grade software with modern languages and tools.
  • Understand software architecture, design, development, debugging, and code review.
  • Communicate clear, structured reasons for technical evaluations.
  • Be based in the United States.
  • Be available for 20 or more hours per week.
  • This is a contractor engagement with an initial one-month term and possible extensions based on performance and fit.
  • Experience with advanced AI systems, large language model training, software benchmarking, automated verification, or agent development is helpful.
About AI training work

AI training work involves people preparing and reviewing examples that help AI systems learn, including code and model responses. Software engineering experience is valuable for judging whether generated code is correct, reliable, and efficient.

Build Python tools to verify code and assess AI-generated solutions across backend, data, machine learning infrastructure, and full-stack projects. This remote US contractor role calls for 20+ hours per week.

Evaluate AI-generated code, create solutions and Python checks, and assess software quality across several languages. This entry-level US-based contractor role requires 20+ hours a week and at least three years of software engineering experience.

Remote, flexible work averages about 15 hours weekly and pays $60 to $120 per hour equivalent, paid per task that meets project specifications.

Research vulnerabilities in private code repositories and turn findings into challenging AI security tasks. The role pays $100 per hour and requires at least 20 hours a week.

Create coding challenges and assess AI-generated software solutions for technical accuracy and good engineering practice. The role pays $40 to $60 per hour and requires at least 20 hours per week.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Python Engineer, LLM Evaluation (US-Based)
Senior Python Engineer, LLM Evaluation (US-Based)

OpenTrain AI, Inc. • United States

Remote
USD 83,000 - 165,000
Senior Software Engineer, LLM Evaluation (US-Based)
Senior Software Engineer, LLM Evaluation (US-Based)

OpenTrain AI, Inc. • United States

Remote
USD 83,000 - 165,000
Remote work
Flexible schedule
Remote Full Stack Engineer
Remote Full Stack Engineer

OpenTrain AI, Inc. • United States

Remote
USD 83,000 - 138,000
Software Engineer, AI Code Evaluation
Software Engineer, AI Code Evaluation

OpenTrain AI, Inc. • United States

Remote
USD 227,000 - 324,000
Senior Backend Engineer (Python/FastAPI) AI Evaluation
Senior Backend Engineer (Python/FastAPI) AI Evaluation

OpenTrain AI, Inc. • United States

Remote
USD 34,000 - 83,000
Software Engineer Open Source Coding Contributor
Software Engineer Open Source Coding Contributor

OpenTrain AI, Inc. • United States

Hybrid
USD 69,000 - 138,000
Remote | Senior Software Engineer - AI Evaluation / Coding Agents — $100–$150/hour
Remote | Senior Software Engineer - AI Evaluation / Coding Agents — $100–$150/hour

24 Mag • New York (NY)

Remote
USD 138,000 - 207,000
Remote Software Engineer for AI Feedback & Evaluation
Remote Software Engineer for AI Feedback & Evaluation

OpenTrain AI, Inc. • United States

Hybrid
USD 165,000 - 193,000
Remote, asynchronous work
Software AI Engineer
Software AI Engineer

AuraOne • United States

Remote
USD 148,000 - 210,000
Computer Science Expert Python Validation
Computer Science Expert Python Validation

OpenTrain AI, Inc. • United States

Remote
USD 21,000 - 55,000
Remote work
Contract-based