Software Engineer, AI Code Evaluation

OpenTrain AI, Inc.

United States

Remote

USD 227,000 - 324,000

Full time

Just now
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

OpenTrain AI, Inc. is seeking a skilled Python developer to evaluate AI-generated code and build Python tools for AI coding systems. This remote US role focuses on code review, example creation, and tooling to identify recurring errors and improve model training.

You will work on production-grade Python solutions, full-stack application practices, and scalable software deployments, collaborating with cross-functional teams to sharpen AI coding workflows. Strong communication is essential.

Qualifications

  • Strong production-grade Python skills and experience with building full-stack apps.
  • Experience deploying scalable software and understanding software design.
  • Ability to review code and provide clear evaluations.
  • Excellent written and spoken communication skills.

Responsibilities

  • Evaluate code across design, APIs, production deployment, testing, monitoring, and maintenance.
  • Assess solutions for efficiency, scalability, reliability, and performance.
  • Collaborate with other teams to improve AI coding systems.

Skills

Python
Full-stack apps
Code review
Debugging
Software design
Communication

Job description

Evaluate AI-generated code and build Python tools for AI coding systems in this remote US role, paying $200 per hour. The initial project runs for one month, with possible extensions.

The work

Create and refine programming examples used to train and assess AI models. You will write and correct code, review AI-generated solutions, and build Python tools that check code quality and identify recurring errors.

  • Evaluate code across software design, APIs, production implementation, testing, monitoring, and maintenance.
  • Assess solutions for efficiency, scalability, reliability, and performance.
  • Work with other teams to improve AI coding systems.
What it pays and takes
  • Pay: $200 per hour.
  • Time commitment: 20 or more hours per week.
  • Location: Remote; open to candidates in the United States.
  • Engagement: Contractor role with an initial one-month project and potential extensions.
  • You should have strong production-grade Python skills, experience building full-stack applications and deploying scalable software, and a strong grasp of software design, development, debugging, and code review.
  • You need strong written and spoken communication skills to explain your evaluations clearly.
About AI training work

AI training work is the human work behind AI systems: people prepare examples and review model outputs so systems can learn from them. Experienced software engineers are needed to create reliable code examples and judge whether AI-generated solutions work well.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer, AI Research and Code Evaluation
Software Engineer, AI Research and Code Evaluation

OpenTrain AI, Inc. • United States

Remote
USD 55,000 - 165,000
Software Engineering, Part-Time AI Evaluation - Remote (United States)
Software Engineering, Part-Time AI Evaluation - Remote (United States)

OpenTrain AI • United States

Remote
USD 69,000 - 138,000
Fully remote
Flexible hours
No commute
Senior Backend Engineer (Python/FastAPI) AI Evaluation
Senior Backend Engineer (Python/FastAPI) AI Evaluation

OpenTrain AI, Inc. • United States

Remote
USD 34,000 - 83,000
Senior Python Engineer, LLM Evaluation (US-Based)
Senior Python Engineer, LLM Evaluation (US-Based)

OpenTrain AI, Inc. • United States

Remote
USD 83,000 - 165,000
Remote | Senior Software Engineer - AI Evaluation / Coding Agents — $100–$150/hour
Remote | Senior Software Engineer - AI Evaluation / Coding Agents — $100–$150/hour

24 Mag • New York (NY)

Remote
USD 138,000 - 207,000
Full-Stack Engineer, Part-Time AI Code Evaluation - Remote (United States)
Full-Stack Engineer, Part-Time AI Code Evaluation - Remote (United States)

OpenTrain AI • United States

Remote
USD 69,000 - 138,000
Code Generation & Evaluation Engineer, Part-Time AI Training Work - Remote (United States)
Code Generation & Evaluation Engineer, Part-Time AI Training Work - Remote (United States)

Mobile Career • Marietta (GA)

Remote
USD 69,000 - 138,000
Remote work
Flexible schedule
Per‑task pay
Remote Full Stack Engineer
Remote Full Stack Engineer

OpenTrain AI, Inc. • United States

Remote
USD 83,000 - 138,000
Senior Software Engineer, LLM Evaluation (US-Based)
Senior Software Engineer, LLM Evaluation (US-Based)

OpenTrain AI, Inc. • United States

Remote
USD 83,000 - 165,000
Remote work
Flexible schedule
Code Generation & Evaluation Engineer, Part-Time AI Training Work - Remote (United States)
Code Generation & Evaluation Engineer, Part-Time AI Training Work - Remote (United States)

OpenTrain AI • United States

Remote
USD 69,000 - 138,000
Remote work
Flexible schedule
Part-time contract