Deep Research Annotator (Computer Science)

Soul AI; Kolkata District; On-site; INR 279,000 - 390,600; Part time

Job summary

A new-age AI solutions firm is looking for a part-time Deep Research Annotator to evaluate computer science reasoning and validate research claims. Candidates should possess a BSc/MSc in Computer Science or related areas, with strong fundamentals in machine learning. Responsibilities include annotating reasoning for various algorithms and systems, validating proofs, and ensuring evidence aligns with claims. The role is perfect for those with research exposure and a keen understanding of ML fundamentals.

Qualifications

• Strong understanding of ML fundamentals, algorithms, or systems architecture.
• Experience reading CS papers, verifying experiments, or debugging code.
• Skilled in evaluating ML claims, algorithmic proofs, code correctness, and research reasoning.

Responsibilities

• Annotate reasoning in ML, algorithms, systems, and security questions.
• Validate code snippets, proofs, and experiment setups.
• Check alignment between claims, evidence, and methodology.
• Identify inconsistencies, hallucinations, or unsupported arguments.
• Produce structured annotations to train high-quality CS models.

Skills

Strong understanding of ML fundamentals

Algorithms

Systems architecture

Evaluating ML claims

Education

BSc/MSc in Computer Science, ML, or related areas

Job description

Deep Research Annotator (Computer Science)

2 days ago Be among the first 25 applicants

Direct message the job poster from Soul AI

We are a new-age AI solutions firm with an ultra-high-quality talent pool out of India for RLHF. Our experts in the specific domain of their expertise help curate hyper-specific LLM datasets. We have operations across the US and India and are working with the top AI firms globally to take their large language models (LLMs) to the next level of quality and consistency.

About the Role

You will evaluate CS reasoning across algorithms, systems, ML, and theoretical concepts. The job involves validating research claims, checking code logic, and analyzing methodology. Ideal for candidates with strong CS fundamentals and research exposure.

Responsibilities

• Annotate reasoning in ML, algorithms, systems, and security questions
• Validate code snippets, proofs, and experiment setups
• Check alignment between claims, evidence, and methodology
• Identify inconsistencies, hallucinations, or unsupported arguments
• Produce structured annotations to train high-quality CS models

Skills & Experience Required

• BSc/MSc in Computer Science, ML, or related areas
• Strong understanding of ML fundamentals, algorithms, or systems architecture
• Experience reading CS papers, verifying experiments, or debugging code
• Skilled in evaluating ML claims, algorithmic proofs, code correctness, and research reasoning.

Seniority Level

Not Applicable

Employment Type

Part-time

Job Function

Engineering and Information Technology

Get notified about new Science Research Specialist jobs in Kolkata, West Bengal, India.