Remote AI Accounting QA Analyst

OperationsArmy; Johannesburg; Remote; ZAR 180,000 - 260,000; Full time

Job summary

OperationsArmy is seeking an Accounting AI Analyst to join our fully remote team in South Africa. You will label and review AI-generated financial data, ensuring accuracy in contracts, AR transactions, and reconciliations while following detailed workflows.

The role suits candidates with data entry, finance operations, QA, or tagging backgrounds who thrive in a structured environment. Strong reading comprehension, English writing skills, and familiarity with accounting terms help you excel.

Qualifications

• 1 to 3 years of experience in data entry, finance operations, customer support, quality assurance, or tagging/labeling roles.
• Strong reading comprehension and ability to follow detailed workflows and task instructions.
• Good written English communication skills for internal documentation and feedback.
• Familiarity with accounting or finance terms (e.g., invoices, cash applications, aging reports) is a plus.
• Comfortable using tools such as Airtable, Google Sheets, and AI annotation platforms.
• Highly reliable, self-motivated, and organized.
• Ability to thrive in a fully remote and fast-paced team environment.

Responsibilities

• Label and tag AI conversations: Accurately annotate AI agent conversations using internal tools such as LangSmith or other proprietary platforms.
• Review and QA AI outputs: Analyze and correct AI-generated outputs related to contracts, accounts receivable transactions, reconciliations, and similar data.
• Identify and escalate issues: Flag logic errors, inconsistencies, or unclear agent behavior, and elevate them to leads or relevant stakeholders.
• Document and report edge cases: Help document unique cases, recurring patterns, or workflow challenges to support model training and improvements.
• Contribute to workflow development: Support the creation of efficient tagging workflows and quality assurance best practices.
• Maintain quality and productivity: Meet or exceed daily output goals while ensuring consistent quality, accuracy, and attention to detail.

Skills

Data entry

Finance operations

Quality assurance

Tagging/labeling

Reading comprehension

Written English

Airtable

Google Sheets

AI annotation tools

Reliability

Organization

Tools

Airtable

Google Sheets

AI annotation tools

Job description

OperationsArmy is seeking an Accounting AI Analyst to join our fully remote team in South Africa. You will label and review AI-generated financial data, ensuring accuracy in contracts, AR transactions, and reconciliations while following detailed workflows.

The role suits candidates with data entry, finance operations, QA, or tagging backgrounds who thrive in a structured environment. Strong reading comprehension, English writing skills, and familiarity with accounting terms help you excel.