Software Engineer, AI Research and Evaluation (US-Based)

OpenTrain AI, Inc.

United States

Remote

USD 83,000 - 165,000

Part time

Just now
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Remote work

Job summary

OpenTrain AI, Inc. is seeking a Software Engineer for AI Research and Evaluation (US-Based). This remote, US-based contractor role requires 20+ hours weekly and initial one-month engagement with possible extension.

You will curate coding examples, review AI-generated code, and build Python tools to verify solutions across languages, contributing to robust AI evaluation workflows.

Qualifications

  • Minimum 3 years of software engineering experience.
  • Deep Python expertise, including production frameworks and tools.
  • Experience building full-stack applications and deploying scalable software.
  • Strong written and spoken communication skills.
  • US-based contractor role with 20+ hours per week.

Responsibilities

  • Curate code examples, write solutions, and correct code for training datasets.
  • Review AI-generated code for efficiency, scalability, reliability, and quality.
  • Build Python agents and automated checks to find error patterns and validate solutions.
  • Evaluate AI capabilities across prototyping, architecture and API design, production implementation, launches, experiments, monitoring, and operational maintenance.
  • Design ways to verify software engineering tasks and write clear reasons for your evaluations.

Skills

Python
Software engineering
Full-stack dev
Code review
Production frameworks
Communication

Tools

Python tooling

Job description

Software Engineer, AI Research and Evaluation (US-Based)

Build coding datasets, Python agents, and verification tools, then assess AI-generated code across several programming languages. US-based contract work requires 20+ hours per week.

Remote

Contract, part-time

Engagement

Remote

Location

Posted

Open to applicants in

United States

The work
  • Curate code examples, write solutions, and correct code for training datasets.
  • Review AI-generated code for efficiency, scalability, reliability, and quality.
  • Build Python agents and automated checks to find error patterns and validate solutions.
  • Evaluate AI capabilities across prototyping, architecture and API design, production implementation, launches, experiments, monitoring, and operational maintenance.
  • Design ways to verify software engineering tasks and write clear reasons for your evaluations.
What it pays and takes
  • Pay: Not provided.
  • Hours: 20+ hours per week.
  • Location: Open to candidates based in the United States.
  • Engagement: Individual contractor role, initially one month, with possible extensions based on performance and fit.
  • At least three years of software engineering experience and deep Python expertise, including production frameworks and tools.
  • Experience building full-stack applications and deploying scalable software.
  • Strong knowledge of software architecture, design, development, debugging, and code review.
  • Strong written and spoken communication skills for explaining technical judgments.
About AI training work

AI training uses examples prepared and reviewed by people to help AI systems learn. Experienced software engineers are needed to create coding examples and judge whether generated code is reliable and well designed.

Requirements

Job details

Location

100% remote

United States

Languages

Engagement

Contract, part-time

Coding & Software

Data type

Computer Code Programming

Computer Programming Coding, Evaluation Rating

Create and solve biology research problems, build Python analyses and models, and review scientific code for AI evaluation. Remote, flexible work averages about 15 hours weekly and pays $60 to $120 per hour equivalent, paid per task that meets project specifications.

Research vulnerabilities in private code repositories and turn findings into challenging AI security tasks. The role pays $100 per hour and requires at least 20 hours a week.

Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more

Create coding challenges and assess AI-generated software solutions for technical accuracy and good engineering practice. The role pays $40 to $60 per hour and requires at least 20 hours per week.

Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more

Build Python tools to verify code and assess AI-generated solutions across backend, data, machine learning infrastructure, and full-stack projects. This remote US contractor role calls for 20+ hours per week.

Evaluate AI-generated code, create solutions and Python checks, and assess software quality across several languages. This entry-level US-based contractor role requires 20+ hours a week and at least three years of software engineering experience.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer, LLM Evaluation (US-Based)
Senior Software Engineer, LLM Evaluation (US-Based)

OpenTrain AI, Inc. • United States

Remote
USD 83,000 - 165,000
Remote work
Flexible schedule
Software Engineer, AI Research and Code Evaluation
Software Engineer, AI Research and Code Evaluation

OpenTrain AI, Inc. • United States

Remote
USD 55,000 - 165,000
Senior Python Engineer, LLM Evaluation (US-Based)
Senior Python Engineer, LLM Evaluation (US-Based)

OpenTrain AI, Inc. • United States

Remote
USD 83,000 - 165,000
Remote Full Stack Engineer
Remote Full Stack Engineer

OpenTrain AI, Inc. • United States

Remote
USD 83,000 - 138,000
Software Engineer, AI Code Evaluation
Software Engineer, AI Code Evaluation

OpenTrain AI, Inc. • United States

Remote
USD 227,000 - 324,000
Senior Backend Engineer (Python/FastAPI) AI Evaluation
Senior Backend Engineer (Python/FastAPI) AI Evaluation

OpenTrain AI, Inc. • United States

Remote
USD 34,000 - 83,000
Software Engineer Open Source Coding Contributor
Software Engineer Open Source Coding Contributor

OpenTrain AI, Inc. • United States

Hybrid
USD 69,000 - 138,000
Remote | Senior Software Engineer - AI Evaluation / Coding Agents — $100–$150/hour
Remote | Senior Software Engineer - AI Evaluation / Coding Agents — $100–$150/hour

24 Mag • New York (NY)

Remote
USD 138,000 - 207,000
Security Engineer, Cybersecurity AI Evaluation
Security Engineer, Cybersecurity AI Evaluation

OpenTrain AI, Inc. • United States

Remote
USD 91,000 - 129,000
Code Generation & Evaluation Engineer, Part-Time AI Training Work - Remote (United States)
Code Generation & Evaluation Engineer, Part-Time AI Training Work - Remote (United States)

OpenTrain AI • United States

Remote
USD 69,000 - 138,000
Remote work
Flexible schedule
Part-time contract