Deep Research Annotator (Computer Science)

Soul AI; Mumbai; On-site; INR 800,000 - 1,200,000; Full time

Job summary

An innovative AI solutions firm is seeking a Deep Research Annotator in Mumbai. This role involves evaluating reasoning across algorithms and systems in machine learning. Candidates should have a BSc/MSc in Computer Science and a strong grasp of ML fundamentals and debugging. Responsibilities include validating research claims and annotating complex reasoning in ML. Join us to contribute to high-quality LLM datasets and work with top AI firms globally.

Qualifications

• Strong understanding of ML fundamentals and algorithms.
• Experience reading and verifying CS papers.
• Skilled in debugging code and evaluating algorithmic proofs.

Responsibilities

• Annotate reasoning in ML, algorithms, and security questions.
• Validate code snippets and experiment setups.
• Check alignment between claims, evidence, and methodology.
• Identify inconsistencies and unsupported arguments.

Skills

Understanding of ML fundamentals

Evaluating ML claims

Algorithmic proofs

Debugging code

Education

BSc/MSc in Computer Science

Related areas

Job description

Deep Research Annotator (Computer Science)

We are a new-age AI solutions firm with an ultra-high-quality talent pool out of India for RLHF. Our experts in the specific domain of their expertise help curate hyper-specific LLM datasets. We have operations across the US and India and are working with the top AI firms globally to take their large language models (LLMs) to the next level of quality and consistency.

About the Role

You will evaluate CS reasoning across algorithms, systems, ML, and theoretical concepts. The job involves validating research claims, checking code logic, and analyzing methodology. Ideal for candidates with strong CS fundamentals and research exposure.

Responsibilities

• Annotate reasoning in ML, algorithms, systems, and security questions.
• Validate code snippets, proofs, and experiment setups.
• Check alignment between claims, evidence, and methodology.
• Identify inconsistencies, hallucinations, or unsupported arguments.
• Produce structured annotations to train high-quality CS models.

Skills & Experience Required

• BSc/MSc in Computer Science, ML, or related areas.
• Strong understanding of ML fundamentals, algorithms, or systems architecture.
• Experience reading CS papers, verifying experiments, or debugging code.
• Skilled in evaluating ML claims, algorithmic proofs, code correctness, and research reasoning.