Remote Software Engineer for AI Feedback & Evaluation

OpenTrain AI, Inc.

Northern (KY)

Hybrid

USD 165,000 - 193,000

Part time

2 days ago
Be an early applicant
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Benefits offered by this job

Remote, asynchronous work

Job summary

OpenTrain AI, Inc. in the United States seeks software engineers for remote, part-time contract work focused on creating realistic programming problems and reviewing AI responses.

You will assess technical accuracy and practicality while ensuring alignment with production engineering practices. Ideal candidates have at least one year of professional or research software engineering experience, a Bachelor's in CS or related field, and strong written communication to explain complex concepts

Qualifications

  • Experience: At least one year of direct professional or research experience as a software engineer.
  • Education: Bachelor's degree in Computer Science or a related technical field.
  • Technical background: Depth in backend systems and distributed architecture, infrastructure and cloud platforms, DevOps, or systems programming and performance engineering.
  • Language: English.

Responsibilities

  • Create challenging software engineering problems and realistic scenarios based on system design, architecture, and implementation work.
  • Evaluate AI-generated software engineering responses for technical accuracy and practical feasibility.
  • Check whether model outputs reflect sound production engineering practices.
  • Write clear, structured feedback that helps improve AI model performance.

Skills

Strong written communication
Attention to detail
Explain complex concepts clearly

Education

Bachelor's degree in Computer Science or related field

Job description

OpenTrain AI, Inc. in the United States seeks software engineers for remote, part-time contract work focused on creating realistic programming problems and reviewing AI responses.

You will assess technical accuracy and practicality while ensuring alignment with production engineering practices. Ideal candidates have at least one year of professional or research software engineering experience, a Bachelor's in CS or related field, and strong written communication to explain complex concepts

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Legal AI Evaluator & Feedback Specialist
Remote Legal AI Evaluator & Feedback Specialist

OpenTrain AI, Inc. • United States

Remote
USD 2,066,000 - 3,444,000
Remote Code Quality Engineer for AI Evaluation
Remote Code Quality Engineer for AI Evaluation

OpenTrain AI, Inc. • United States

Remote
USD 34,000 - 69,000
Remote Software Engineer for AI Code Evaluation
Remote Software Engineer for AI Code Evaluation

OpenTrain AI • Northern (KY)

Hybrid
USD 138,000 - 207,000
Remote contractor
Part-time engagement
Hourly pay $100–$150 USD
+1
Software Engineer AI Code Evaluation
Software Engineer AI Code Evaluation

OpenTrain AI, Inc. • Northern (KY)

Hybrid
USD 138,000 - 207,000
Remote contractor
Part-time engagement
Hourly pay $100–$150 USD
+1
Remote AI Software Engineer — Training & Evaluation
Remote AI Software Engineer — Training & Evaluation

AfterQuery Experts • Seattle (WA)

Remote
USD 69,000 - 138,000
Competitive pay
One assessment
Remote & asynchronous
Remote Electrical Engineering AI Evaluation Specialist
Remote Electrical Engineering AI Evaluation Specialist

OpenTrain AI, Inc. • Northern (KY)

Hybrid
USD 99,000 - 165,000
Remote Senior Software Engineer Open-Source AI Evaluations
Remote Senior Software Engineer Open-Source AI Evaluations

YO AI Labs • Houston (TX)

On-site
USD 50,000 - 80,000
Remote Contract Software Engineer — AI Evaluation & Automation
Remote Contract Software Engineer — AI Evaluation & Automation

RemoteJobsOne • Atlanta (GA)

Remote
USD 69,000 - 96,000
Remote Full-Stack Engineer — AI Code Evaluation
Remote Full-Stack Engineer — AI Code Evaluation

OpenTrain AI, Inc. • United States

On-site
USD 69,000 - 138,000
Remote Software Engineer — AI Training & Evaluation
Remote Software Engineer — AI Training & Evaluation

Alignerr Corp. • Dallas (TX)

On-site
USD 14,000 - 55,000