Remote Senior Software Engineer Evaluator (Contract)

Mercor; San Francisco (CA); Hybrid; GBP 104,000 - 156,000; Full time

Job summary

Mercor is seeking a Software Engineer Expert for a remote contract role. You will evaluate AI-generated artifacts for usability in software engineering, identify errors in slides, spreadsheets, and documents, and provide structured feedback to improve AI model outputs.

You will apply deep subject-matter expertise to grade outputs and enhance quality, working independently to meet deadlines and boost AI model performance.

Qualifications

• 5+ years of professional experience in Software Engineering at a top firm.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace (PowerPoint, Excel, Word).

Responsibilities

• Evaluate AI-generated artifacts for usability in a software engineering context.
• Identify factual, aesthetic, and presentation errors in slides, spreadsheets, and documents.
• Provide clear, structured written feedback to improve AI model outputs.
• Apply deep subject-matter expertise to grade outputs and enhance quality.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Skills

English fluency

Education

Master's degree

Tools

Microsoft Office

Google Workspace

Job description

Mercor is seeking a Software Engineer Expert for a remote contract role. You will evaluate AI-generated artifacts for usability in software engineering, identify errors in slides, spreadsheets, and documents, and provide structured feedback to improve AI model outputs.

You will apply deep subject-matter expertise to grade outputs and enhance quality, working independently to meet deadlines and boost AI model performance.