Join to apply for the Domain Agnostic Deep Research Annotator (Freelancer) role at Soul AI
Soul AI is a pioneering company founded by IIT Bombay and IIM Ahmedabad alumni, with a strong founding team from IITs, NITs, and BITS. We specialize in delivering high‑quality human‑curated data, AI‑first scaled operations services, and more. Based in SF and Hyderabad, we are a young, fast‑moving team on a mission to build AI for Good, driving innovation and positive societal impact.
About the Role
As a Domain Agnostic Deep Research Annotator (Freelancer), you will work on advanced AI training and evaluation tasks that span multiple knowledge domains. This role focuses on assessing deep research outputs for accuracy, reasoning quality, evidence use, and synthesis—independent of any single subject area. You will evaluate long‑form, research‑style AI responses that require critical thinking, structured analysis, and rigorous validation rather than domain‑specific memorization.
Responsibilities
- Evaluate research across multiple fields
- Annotate and evaluate deep research tasks across diverse domains such as science, technology, economics, policy, law, social sciences, and humanities.
- Review AI‑generated research outputs for logical structure, multi‑step reasoning, and internal consistency.
- Assess the quality of synthesis across multiple sources, concepts, or perspectives.
- Identify and tag issues such as unsupported claims, reasoning gaps, shallow analysis, or hallucinated facts or citations.
- Evaluate whether conclusions are well‑supported by evidence and clearly derived from preceding analysis.
- Compare and rank multiple AI‑generated responses based on rigor, clarity, depth, and trustworthiness.
- Provide structured feedback to help improve AI performance on research‑grade tasks.
Skills & Experience Required
- Broad research background
- 2–5 yrs analytical experience
- Strong reading comprehension and synthesis capabilities
- Ability to evaluate diverse reasoning styles
- Multi‑domain reasoning and structured synthesis
Why Join Us?
- Work on high‑impact projects that contribute to building AI for Good.
- Collaborate with top‑tier engineers and domain experts from IITs, NITs, and BITS.
- Opportunity to grow in a fast‑paced, innovation‑driven environment.
NOTE: This will be a flexible freelancing opportunity. Pay will vary by project and typically is up to ₹1500 per hour.
Seniority level
Employment type
Job function
- Engineering and Information Technology
Industries
- IT Services and IT Consulting
Referrals increase your chances of interviewing at Soul AI by 2x.