Remote Part-Time Software Engineer – AI Evaluation

24-Mag Llc; New York, Northern (NY, KY); Hybrid; USD 124,000 - 193,000; Part time

Job summary

24-MAG LLC invites experienced Software Engineers to join a part-time, fully remote evaluation project. You will analyze AI-generated technical outputs, assess accuracy and clarity, and craft detailed written rationales to support each evaluation.

No software development required. Ideal candidates bring strong software engineering experience, exceptional written English, and a proven ability to review technical content with precision.

Qualifications

• Professional Software Engineer with a modern technology stack.
• Excellent written communication in English.
• Experience reviewing technical documentation and API references.
• Ability to provide structured feedback on technical writing.

Responsibilities

• Evaluate and score AI-generated technical responses for correctness and usefulness.
• Review technical content (docs, API references, specs) for clarity and completeness.
• Write detailed rationales distinguishing factual accuracy, communication quality, and relevance.
• Work asynchronously within remote evaluation workflows.

Skills

Software engineering

Technical writing

Code review

Analytical thinking

Remote collaboration

Attention to detail

Job description

24-MAG LLC invites experienced Software Engineers to join a part-time, fully remote evaluation project. You will analyze AI-generated technical outputs, assess accuracy and clarity, and craft detailed written rationales to support each evaluation.

No software development required. Ideal candidates bring strong software engineering experience, exceptional written English, and a proven ability to review technical content with precision.