Remote AI Personalization Quality Analyst

E-Solutions

Singapore

Remote

SGD 48,000 - 72,000

Full time

2 days ago
Be an early applicant
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

E-Solutions is hiring a full-time AI evaluation specialist to join a global remote team. You will design 1–5 turn prompts that leverage personal context, assess personalization and grounding, and compare model responses side-by-side.

You will write clear rationales, referencing specific turns, and verify debug information while maintaining strict data hygiene. The role requires strong analytical thinking, exceptional written communication, and the ability to work independently in a remote

Qualifications

  • BS/BA degree or equivalent experience in a relevant field (e.g., Policy, Law, Ethics, Linguistics, Journalism, CS).
  • Experience in data annotation, AI quality evaluation, content moderation, or related role strongly preferred.

Responsibilities

  • Design and execute multi-turn prompts (1–5 turns) to test personalization.
  • Evaluate model responses for personalization and grounding quality.
  • Analyze responses for grounding issues and ensure evidence supports claims.
  • Rank side-by-side model responses and write defensible rationales referencing turn numbers.
  • Extract and verify debug info from the model and ensure proper data sources are used.
  • Maintain strict data hygiene by deleting evaluation conversations to prevent history pollution.

Skills

Analytical thinking
Attention to detail
Written communication
Independence
Communication

Education

BS/BA degree

Job description

E-Solutions is hiring a full-time AI evaluation specialist to join a global remote team. You will design 1–5 turn prompts that leverage personal context, assess personalization and grounding, and compare model responses side-by-side.

You will write clear rationales, referencing specific turns, and verify debug information while maintaining strict data hygiene. The role requires strong analytical thinking, exceptional written communication, and the ability to work independently in a remote

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Quality Analyst (Personalization) – Chinese
AI Quality Analyst (Personalization) – Chinese

E-Solutions • Singapore

Remote
SGD 48,000 - 72,000
Remote Psychology QA Lead — Elevating AI Safety & Accuracy
Remote Psychology QA Lead — Elevating AI Safety & Accuracy

YO IT Consulting • Singapore

On-site
SGD 83,322 - 108,960
Remote AI Safety Red Team Specialist (EN/ID)
Remote AI Safety Red Team Specialist (EN/ID)

Obsidian • Singapore

On-site
SGD 153,000 - 230,000
Remote work options
Wellness resources
Remote Political Science QA Lead
Remote Political Science QA Lead

YO IT Consulting • Singapore

On-site
SGD 62,278 - 88,969
Agent Evaluation Engineer for an AI Agent Company
Agent Evaluation Engineer for an AI Agent Company

DADACONSULTANTS PTE. LTD. • Singapore

On-site
SGD 90,000 - 180,000
Frontier AI team
Unlimited AI tools access
Competitive salary
Market Research Expert
Market Research Expert

SME Careers • Singapore

Remote
SGD 55,000 - 110,000
Remote Financial AI Compliance Evaluator (Contract)
Remote Financial AI Compliance Evaluator (Contract)

mercor • Singapore

Remote
SGD 141,000 - 212,000
AI Market Research SME: Remote Expert Insights & QA
AI Market Research SME: Remote Expert Insights & QA

SME Careers • Singapore

Remote
SGD 55,000 - 110,000
Remote AI Safety Red Team Specialist
Remote AI Safety Red Team Specialist

Mercor • Singapore

On-site
SGD 90,000 - 130,000
AI Agent Evaluation Architect
AI Agent Evaluation Architect

Manus AI • Singapore

On-site
SGD 90,000 - 150,000
Equity plan
Unlimited Manus Tokens
Frontier AI projects