Software Engineering Expert - Fully Remote | Up To $180/Hr

Mercor; Sydney; A distancia; AUD 235.000 - 353.000; A tiempo parcial

Descripción de la vacante

Mercor is seeking Senior Software Engineering Experts for a contract, remote role to design and review realistic software tasks for AI model evaluation. You will assess code quality, write proposals, and document verification criteria.

Applicants should have 4+ years of software engineering experience and mastery of languages like Python, Java, C++, Go, TypeScript, or Rust, plus a Bachelor’s degree from an English-speaking country. Strong written English is essential.

Formación

• 4+ years of professional software engineering experience at leading tech, quantitative, or financial firms.
• Strong command of at least one major language like Python, Java, C++, Go, TypeScript, or Rust.
• Excellent written English for explaining technical decisions and trade-offs.

Responsabilidades

• Design realistic, challenging software engineering tasks from real-world work.
• Write task proposals explaining realism, verification, and challenges for current AI models.
• Illustrate what good looks like with reference solutions, tests, and criteria.

Conocimientos

4+ years exp

Python

Java

C++

Go

TypeScript

Rust

English writing

Educación

Bachelor's degree

Descripción del empleo

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Senior Software Engineering Experts
Type: Contract
Compensation: $120–$180/hour
Location: Remote

Role Responsibilities

• Design realistic, challenging software engineering tasks from real-world work. Tasks include feature changes, debugging, root-cause analysis, code review, system design, and technical documentation.
• Write clear task proposals explaining task realism, verification, and challenges for current AI models.
• Illustrate "what good looks like" with reference solutions, tests, and criteria covering correctness, architecture, maintainability, style, and scope.
• Assess AI-generated code and engineering work, collaborating with AI coding agents to evaluate success and failure.
• Apply consistent, evidence-based judgment for reproducible and defensible assessments.
• Take structured feedback from senior reviewers and iterate on submitted work.

Qualifications

Must-Have

• 4+ years of professional software engineering experience at leading technology, quantitative, or financial firms.
• Strong command of at least one major language like Python, Java, C++, Go, TypeScript, or Rust.
• Proven ability to work in large, complex production codebases and judge code quality.
• Excellent written English for explaining technical decisions and trade-offs.
• Bachelor's degree from an English-speaking country.
• Detail-oriented and consistent in evaluating complex work.
• Comfortable receiving feedback and calibrating judgment against set standards.