Software Engineering Expert

Alpheva; United States; Remote; USD 234,000 - 303,000; Part time

Job summary

Alpheva is seeking a senior software engineering expert to work on AI evaluation projects focused on production code, system design, tests, and failure handling. You will review model responses and worked examples for incorrect assumptions, missing failure cases, and reliability or security gaps.

Assess whether the reasoning meets professional standards for the stated task. This is a remote, project-based contract engagement.

Qualifications

• 7+ years of professional software engineering experience.
• Senior-level judgment in production code, system design, tests, and failure handling, with substantial responsibility for reviewing or delivering this work.
• Ability to write precise reference answers, assess competing approaches, and justify corrections with traceable evidence.

Responsibilities

• Review model responses and worked examples for correctness, reliability, and security gaps.
• Assess whether reasoning meets professional standards for the stated task.
• Write reference answers and scoring criteria grounded in production code practices, system design, tests, and failure handling.
• Explain consequential errors, evidence gaps, and the reasoning behind corrections.

Skills

Senior-level judgment

Production code

System design

Testing

Failure handling

Job description

Bring senior software expertise to AI evaluation projects focused on production code, system design, tests, and failure handling.

Review model responses and worked examples for incorrect technical assumptions, missing failure cases, and reliability or security gaps. Assess whether the reasoning meets professional standards for the stated task.

Write reference answers and scoring criteria grounded in production code, system design, tests, and failure handling. Explain consequential errors, evidence gaps, and the reasoning behind your corrections.

This is remote, project-based contract work. Scope, hours, and assignments depend on project matching; the listed hourly range applies to matched work.

Requirements

• 7+ years of substantive experience in professional software engineering.
• Demonstrated senior-level judgment in production code, system design, tests, and failure handling, with substantial responsibility for reviewing or delivering this work.
• Ability to write precise reference answers, assess competing approaches, and justify corrections with traceable evidence.

Pay

$170–$220/hr

Alpheva is a new expert network (launched September 2026); payout methods are not published yet, so confirm your first payment before scaling up.