Remote Technical Writer for AI Benchmark Evaluations

YO IT Consulting; Auckland; On-site; NZD 70,000 - 110,000; Full time

Job summary

YO IT Consulting is seeking experienced Technical Writers to contribute to an AI benchmark project. You will craft realistic evaluation tasks, assemble source materials, and assess AI outputs for accuracy, clarity, and audience alignment.

Ideal candidates have 2–4+ years in technical writing, strong English, and a proven ability to produce precise, testable documentation. This is a remote contractor role with fast onboarding and delivery expectations.

Qualifications

• 2-4+ years of technical writing experience in software, hardware, regulated industries.
• Ability to create precise, testable technical documentation and instructions.
• Experience with style guides, structured authoring, and documentation toolchains.
• Excellent written English and ability to tailor depth for different audiences.
• Strong analytical and synthesis skills.
• Experience creating acceptance criteria or evaluation rubrics is a plus.
• Familiarity with technical benchmarking or evaluation methodologies is desirable.

Responsibilities

• Design realistic technical evaluation tasks using CSVs, PDFs, spreadsheets, code samples, and technical documents.
• Create and curate source materials such as product specifications, SME notes, regulatory documents, and technical references.
• Define expected solutions, acceptance criteria, and output requirements.
• Develop detailed 35+ point grading rubrics covering accuracy, precision, testability, and audience alignment.
• Create documentation tasks including API references, user guides, technical instructions, and compliance documents.
• Synthesize complex source material into clear, precise, and actionable documentation.
• Collaborate asynchronously with project teams to refine deliverables.

Skills

Precision Writing

Source Synthesis

Audience Calibration

Technical Writing

Structured Authoring

Documentation

Analytical Reasoning

Technical Editing

Acceptance Criteria & Rubric Dev

Job description

YO IT Consulting is seeking experienced Technical Writers to contribute to an AI benchmark project. You will craft realistic evaluation tasks, assemble source materials, and assess AI outputs for accuracy, clarity, and audience alignment.

Ideal candidates have 2–4+ years in technical writing, strong English, and a proven ability to produce precise, testable documentation. This is a remote contractor role with fast onboarding and delivery expectations.