Computer Science Research Annotator

Soul Ai; Mumbai, Delhi, Bengaluru; On-site; INR 3,000,000 - 4,200,000; Full time

Job summary

Soul Ai is seeking a researcher to perform deep technical reading of ML, AI, systems, and security research to verify claims and detect inconsistencies. You will review papers, analyze code, and ensure factual and logical accuracy across CS research domains.

The role focuses on evaluating methodologies, proofs, and assumptions, annotating ambiguities, and collaborating with QA leads to maintain high annotation quality. Strong fundamentals and papers-experience are essential.

Qualifications

• MS/PhD in CS or 25 years experience.
• Strong fundamentals in ML, DL, systems, or security.
• Experience reading academic papers (NeurIPS, ICML, ICLR, USENIX).
• Ability to evaluate methodology, assumptions, and proofs.
• Familiarity with code review and logic debugging.
• Excellent analytical skills and attention to detail.

Responsibilities

• Read and interpret ML/AI, systems, and security research papers.
• Validate technical claims, algorithms, and formal reasoning.
• Classify hallucinations and detect inconsistencies in arguments.
• Review and verify code snippets or pseudocode.
• Evaluate evidence alignment and correctness of methodology.
• Annotate errors, ambiguities, and unsupported claims.
• Collaborate with QA leads to maintain annotation quality standards.

Skills

ML fundamentals

Paper reading

Code review

Analytical thinking

Attention to detail

Reasoning verification

Education

MS/PhD in Computer Science or 25 years experience

Job description

About the Role

This role involves deep technical reading of ML, AI, systems, and security research, evaluating claims, verifying reasoning steps, and identifying inconsistencies in academic or technical content. You will review research papers, analyze code snippets, and ensure factual and logical accuracy across complex CS research domains.

Responsibilities

• Read and interpret ML/AI, systems, and security research papers.
• Validate technical claims, algorithmic steps, and formal reasoning.
• Classify hallucinations and detect inconsistencies in research arguments.
• Review and verify code snippets or pseudocode.
• Evaluate evidence alignment and correctness of methodology.
• Annotate errors, ambiguities, and unsupported claims.
• Collaborate with QA leads to maintain annotation quality standards.

Skills & Experience Required

• MS/PhD in Computer Science OR 25 years research/industry experience.
• Strong fundamentals in machine learning, deep learning, systems, or security.
• Experience reading academic papers (NeurIPS, ICML, ICLR, USENIX, etc.)
• Ability to evaluate research methodology, assumptions, and proofs.
• Familiarity with code review and logic debugging.
• Excellent analytical skills and attention to detail.
• able to parse research papers, verify reasoning, and catch subtle inconsistencies.

Location - India,Mumbai, Delhi / NCR, Bengaluru , Kolkata, Chennai, Hyderabad, Ahmedabad, Pune