Senior Software Engineer - Remote Contract, AI Evaluation

Mercor; Sydney; Remote; AUD 235,000 - 353,000; Part time

Job summary

Mercor is seeking Senior Software Engineering Experts for a contract, remote role to design and review realistic software tasks for AI model evaluation. You will assess code quality, write proposals, and document verification criteria.

Applicants should have 4+ years of software engineering experience and mastery of languages like Python, Java, C++, Go, TypeScript, or Rust, plus a Bachelor’s degree from an English-speaking country. Strong written English is essential.

Qualifications

• 4+ years of professional software engineering experience at leading tech, quantitative, or financial firms.
• Strong command of at least one major language like Python, Java, C++, Go, TypeScript, or Rust.
• Excellent written English for explaining technical decisions and trade-offs.

Responsibilities

• Design realistic, challenging software engineering tasks from real-world work.
• Write task proposals explaining realism, verification, and challenges for current AI models.
• Illustrate what good looks like with reference solutions, tests, and criteria.

Skills

4+ years exp

Python

Java

C++

Go

TypeScript

Rust

English writing

Education

Bachelor's degree

Job description

Mercor is seeking Senior Software Engineering Experts for a contract, remote role to design and review realistic software tasks for AI model evaluation. You will assess code quality, write proposals, and document verification criteria.

Applicants should have 4+ years of software engineering experience and mastery of languages like Python, Java, C++, Go, TypeScript, or Rust, plus a Bachelor’s degree from an English-speaking country. Strong written English is essential.