Business Analyst with AI evaluation skills

Gramian Consulting; Brasil; Remote; BRL 33,480 - 55,800; Part time

Benefits offered by this job

Fully remote environment

Work on cutting-edge AI projects

Job summary

A boutique consultancy is seeking a Business Analyst to support evaluation workflows focused on quality and accuracy. This fully remote role requires strong analytical skills and attention to detail, with responsibilities including evaluations, fact-checking, and justifying decisions. Candidates should be comfortable using digital tools and have good communication skills in English. The contract lasts for 2 months and entails 6-8 hours of work per day with required overlap with PST.

Qualifications

• Solid comfort using a computer in a professional setting.
• Ability to run basic command-line commands.
• Previous experience with evaluation, annotation, QA, or audit-type work.

Responsibilities

• Perform side-by-side evaluations on outputs, assessing quality and accuracy.
• Conduct fact-checking to validate information.
• Provide clear justifications to support evaluation decisions.
• Use browser-based tools for analysis and review.
• Document findings and communicate insights to stakeholders.

Skills

Analytical skills

Attention to detail

Critical thinking

Written communication in English

Tools

Browser extensions

Basic command-line tools

Job description

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

Role Overview

We are looking for a detail-oriented Business Analyst to support evaluation and annotation workflows focused on quality, accuracy, and structured reasoning. This role is ideal for someone who is comfortable working with digital tools, performing side-by-side evaluations, and providing clear, well-supported justifications based on fact-checking.

What You\'ll Do

• Perform side-by-side (SxS) evaluations on GHD, comparing outputs and assessing quality, accuracy, and relevance
• Conduct fact-checking to validate information and identify inconsistencies or inaccuracies
• Provide detailed, well-structured justifications to support evaluation decisions
• Follow established evaluation guidelines and quality standards consistently
• Use browser-based tools and extensions to support analysis and review tasks
• Execute simple command-line instructions when required to support evaluation workflows
• Document findings clearly and communicate insights to stakeholders when needed

Commitments Required

6-8 hours per day with an overlap of 3 hours with PST.

Employment Details

Employment type: Contractor assignment (no medical/paid leave)

Duration of contract: 2 months

Location: Argentina, Brazil, Peru, Colombia, Chile, Mexico

Selection process: 60 min technical test (comparing AI outputs)

Requirements

• Solid comfort using a computer in a professional setting
• Experience working with browser extensions and online tools
• Ability to run basic command-line commands (no advanced programming required)
• Strong analytical and critical thinking skills
• High attention to detail and ability to justify decisions clearly and objectively
• Comfortable working with evaluation frameworks, comparisons, and structured analysis
• Previous experience with evaluation, annotation, QA, or audit-type work
• Familiarity with data quality, content evaluation, or model/output assessments
• Good written communication skills in English

Benefits

• Work in a fully remote environment
• Opportunity to work on cutting-edge AI projects with leading Tech companies