Senior Software Engineer: AI Task Design & Code Evaluation

Mercor; United States; Remote; USD 165,000 - 248,000; Part time

Job summary

Mercor seeks senior software engineers to train and evaluate frontier AI models by designing realistic software engineering tasks drawn from real-world work. You will work on feature changes in large codebases, debugging, code review, system design, and documentation, while writing clear task proposals and reference solutions to guide AI agents.

Ideal candidates have 4+ years at top technology or quant firms or leading banks/tech firms, strong progs in Python/Java/C++, and excellent English

Qualifications

• 4+ years of professional software engineering experience.
• Experience at a leading technology or quantitative firm or top-tier financial institution.
• Excellent written English and ability to explain technical decisions clearly.
• Bachelor's degree from an English-speaking country.

Responsibilities

• Design realistic, challenging software engineering tasks from real-world work, including feature changes in large codebases.
• Perform debugging and root-cause analysis, code review, and system design decisions.
• Prepare task proposals that explain realism, verification, and difficulty for AI models.
• Write reference solutions, tests, and precise criteria covering correctness, architecture, maintainability and scope.
• Assess AI-generated code, work with AI coding agents, and provide judgment against set standards.

Skills

Python

Java

C++

Go

TypeScript

Rust

System design

Testing

Code review

Debugging

Education

Bachelor's degree

Tools

Git

Job description

Mercor seeks senior software engineers to train and evaluate frontier AI models by designing realistic software engineering tasks drawn from real-world work. You will work on feature changes in large codebases, debugging, code review, system design, and documentation, while writing clear task proposals and reference solutions to guide AI agents.

Ideal candidates have 4+ years at top technology or quant firms or leading banks/tech firms, strong progs in Python/Java/C++, and excellent English