Computer & Information Systems Specialist - Freelance AI Trainer Project

agency; United States; Remote; USD 8,300 - 90,000; Part time

Benefits offered by this job

Remote work

Freelance contract

Job summary

Agency seeks a detail-oriented evaluator to assess language models' ability to reason about computer information systems. You will apply IT and systems expertise to practical scenarios, verifying technical accuracy and sound logic.

In this remote freelance role, you will discuss IT situations, test architecture topics, capture error traces, and recommend prompt and evaluation-method improvements.

Qualifications

• Strong knowledge of computer information systems, IT, or related technical area.
• Clear, analytical communication showing how conclusions were reached.
• Bachelor’s or Master’s degree preferred in related field.

Responsibilities

• Discuss real-world IT situations and theoretical systems architecture questions with a language model.
• Evaluate responses for technical accuracy and logical consistency.
• Test subjects including software architecture, systems analysis, data management, cloud infrastructure, cybersecurity, database design, and IT project management.
• Probe enterprise integration, information governance, network configuration, security frameworks, distributed computing, SDLC, and IT compliance.
• Capture reproducible error traces and recommend changes to prompts and evaluation methods.

Skills

Analytical thinking

Clear communication

IT knowledge

Education

Bachelor’s or Master’s degree in computer information systems/IT/CS

Job description

Role overview

Assess and strengthen language models’ ability to reason about computer and information systems. The work applies systems and IT expertise to practical scenarios and architecture questions, checks technical answers for accuracy and sound logic, and produces clear evidence of model errors to inform improvements.

Responsibilities

• Discuss real-world IT situations and theoretical systems architecture questions with a language model.
• Evaluate responses for technical accuracy and logical consistency.
• Test subjects including software architecture, systems analysis, data management, cloud infrastructure, cybersecurity, database design, and IT project management.
• Probe enterprise integration, information governance, network configuration, security frameworks, distributed computing, SDLC, and IT compliance.
• Capture reproducible error traces and recommend changes to prompts and evaluation methods.

Requirements

• Strong knowledge of computer and information systems, IT, or a closely related technical area.
• Clear, analytical communication and the ability to show how conclusions were reached.
• A bachelor’s or master’s degree in computer information systems, information technology, computer science, or a related field is preferred.
• Relevant certifications, enterprise deployment experience, or technical writing projects are useful indicators of fit.

Benefits and work setup

• Freelance contract, remote.
• Listed pay range is $6–$65 per hour; the final rate depends on experience, expertise, and location and may differ from the range.
• Contractors provide a secure computer and high-speed internet.
• Employer-sponsored health insurance and paid time off are not included.