Remote Accounting AI QA Analyst

OperationsArmy; East London; Remote; ZAR 240,000 - 360,000; Full time

Job summary

OperationsArmy is seeking a detail-oriented Accounting AI Analyst for a fully remote role in South Africa. You will label and review AI outputs, annotate conversations, and help improve model performance within a structured, fast-paced environment.

Ideal candidates have 1–3 years in data entry, finance ops, or QA, with strong reading comprehension and excellent written English. Proficiency in Airtable, Google Sheets, and AI annotation tools is a plus.

Qualifications

• 1 to 3 years of experience in data entry, finance operations, customer support, quality assurance, or tagging/labeling roles.
• Strong reading comprehension and ability to follow detailed workflows and task instructions.
• Good written English communication skills for internal documentation and feedback.
• Familiarity with accounting or finance terms is a plus.
• Comfortable using Airtable, Google Sheets, and AI annotation platforms.
• Highly reliable, self-motivated, and organized.
• Ability to thrive in a fully remote and fast-paced team environment.

Responsibilities

• Label and annotate AI conversations using internal tools such as LangSmith or other proprietary platforms.
• Review and QA AI outputs related to contracts, accounts receivable transactions, reconciliations, and similar data.
• Identify and escalate issues by flagging logic errors or unclear agent behavior.
• Document and report edge cases to support model training and improvements.
• Contribute to workflow development and quality assurance best practices.
• Maintain quality and productivity, meeting daily output goals in a remote setting.

Skills

Data entry

Finance operations

Customer support

Quality assurance

Tagging/labeling

Reading comprehension

Written English

Reliability

Organization

Tools

Airtable

Google Sheets

AI Annotation Tools

Job description

OperationsArmy is seeking a detail-oriented Accounting AI Analyst for a fully remote role in South Africa. You will label and review AI outputs, annotate conversations, and help improve model performance within a structured, fast-paced environment.

Ideal candidates have 1–3 years in data entry, finance ops, or QA, with strong reading comprehension and excellent written English. Proficiency in Airtable, Google Sheets, and AI annotation tools is a plus.