Software Engineer

RemoExperts

United States

Remote

USD 90,000 - 145,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AI Trainer Jobs is seeking experienced software engineers to train and evaluate AI models on real-world programming work. You will design coding tasks, review AI-generated code, and write the reference solutions and tests used to measure models.

You will build reproducible environments with Git and Docker, write robust tests, and articulate design decisions behind reference solutions while communicating clearly in English. Remote role with international collaboration.

Qualifications

  • Degree in computer science or related field, or equivalent professional experience.
  • 3+ years of professional software engineering experience.
  • Strong Python, plus at least one of Java, C++, TypeScript, Go or Rust.
  • Proficiency with Git, Docker and automated testing.
  • Ability to read and navigate unfamiliar codebases.
  • Fluent written English and clear technical communication.
  • Reliable, detail-oriented, and able to work independently and meet deadlines in a remote setting.

Responsibilities

  • Design realistic coding tasks (bug fixes, feature implementation, refactoring, performance optimisation) with clear specifications.
  • Build reproducible environments (Git, Docker) and write automated test suites that verify solutions.
  • Write high-quality reference solutions and explain the design decisions behind them.
  • Evaluate AI-generated code for correctness, performance, security and readability.
  • Rank and compare model outputs and justify your judgments in clear written rationale.
  • Identify recurring failure patterns in model output and report them to the project team.
  • Follow project guidelines, take part in calibration and review sessions, and incorporate feedback to keep quality consistent.

Skills

Python
Java
C++
TypeScript
Go
Rust
Git
Docker
Automated testing
Technical communication

Education

CS degree or related field

Tools

Git
Docker
CI/CD

Job description

Back
Software Engineer
Computer Science
Related Skills

No related skills for this job.

Available in
All Countries

About the Role

We are looking for experienced software engineers to help train and evaluate AI models on real-world programming work. You will build and validate coding tasks, review AI-generated code, and write the reference solutions and tests that models are measured against. Your engineering judgment directly shapes how reliably AI systems write, debug and refactor code.

  • Design realistic coding tasks (bug fixes, feature implementation, refactoring, performance optimisation) with clear specifications.
  • Build reproducible environments (Git, Docker) and write automated test suites that verify solutions.
  • Write high-quality reference solutions and explain the design decisions behind them.
  • Evaluate AI-generated code for correctness, performance, security and readability.
  • Rank and compare model outputs and justify your judgments in clear written rationale.
  • Identify recurring failure patterns in model output and report them to the project team.
  • Follow project guidelines, take part in calibration and review sessions, and incorporate feedback to keep quality consistent.
Who We're Looking For
Required Qualifications
  • Degree in computer science or a related field, or equivalent professional experience.
  • 3+ years of professional software engineering experience.
  • Strong Python, plus at least one of Java, C++, TypeScript, Go or Rust.
  • Proficiency with Git, Docker and automated testing.
  • Ability to read and navigate unfamiliar codebases.
  • Fluent written English and clear technical communication.
  • Reliable, detail-oriented, and able to work independently and meet deadlines in a remote setting.
Preferred Qualifications
  • Open-source contributions or code-review experience.
  • Experience with test automation, CI/CD or developer tooling.
  • Prior LLM evaluation or data annotation experience.
  • Experience with large or distributed codebases.
Legal and Compliance Notice

All content you submit must be lawful, and you must have the right to share it.
Do not submit confidential or proprietary material belonging to an employer, client or third party, or personal data without a lawful basis.
Rex may verify identity, credentials, ownership and licensing; may reject or remove any submission; and may report unlawful submissions to the relevant authorities.
Engagement and payment are subject to successful verification and to applicable sanctions, export-control, tax and employment laws.
The contractor agreement will set out ownership and licence terms for the work you deliver (to be confirmed by Rex Legal).

Compensation

USD $65–105 per hour, adjusted by country of residence.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GitHub Contributor
GitHub Contributor

RemoExperts • United States

Remote
USD 69,000 - 138,000
Software Engineering Expert (AI Training)
Software Engineering Expert (AI Training)

Weekday AI • United States

Remote
USD 138,000 - 317,000
Remote | Software Engineer (Open Source Contributor) — $50–$100/hour
Remote | Software Engineer (Open Source Contributor) — $50–$100/hour

24-MAG • United States

Remote
USD 69,000 - 138,000
DevOps Engineer
DevOps Engineer

RemoExperts • United States

Remote
USD 69,000 - 207,000
Remote Senior Software Engineer Contractor for AI Tasks
Remote Senior Software Engineer Contractor for AI Tasks

Weekday • United States

Remote
USD 138,000 - 317,000
Remote | Software Developer — $50–$70/hour
Remote | Software Developer — $50–$70/hour

24-MAG • United States

Remote
USD 69,000 - 96,000
Fully remote
Freelance/Contract
Junior Software Engineer
Junior Software Engineer

Weekday • Oregon

Remote
USD 207,000 - 276,000
Remote work
Senior Software Engineer
Senior Software Engineer

Weekday AI • United States

Remote
USD 41,000 - 138,000
Software Engineer - AI Trainer
Software Engineer - AI Trainer

DataAnnotation • Wichita (KS)

Remote
USD 69,000 - 138,000
Choose projects & schedule
Remote work from home
Competitive hourly pay
+2
Software Engineer - AI Trainer
Software Engineer - AI Trainer

DataAnnotation • Kirkland (WA)

Remote
USD 69,000 - 138,000
Flexible schedule
Remote work from home