Media Experts | $300/task

Codefeast; India; Remote; INR 1,800,000 - 3,000,000; Part time

Job summary

Codefeast is seeking experienced professionals in music, audio processing, speech technology, and computational linguistics to develop and review terminal-based tasks for AI agent evaluation. You will apply domain expertise to create realistic workflows, validate outputs, and ensure tasks reflect practical professional or research activities.

Prior hands-on experience with Terminal-Bench 3.0 projects is mandatory.

Qualifications

• Bachelor's degree and 6+ years of relevant professional experience.
• Experience in media, music, linguistics, or audio domains.
• Ability to translate workflows into concrete test tasks.

Responsibilities

• Design multi-step tasks based on realistic media, music, speech, or linguistic workflows.
• Prepare input datasets, audio samples, linguistic data, and processing configurations.
• Configure reproducible computational environments and relevant domain-specific tools.
• Implement reference solutions and objective validation tests.
• Review output accuracy, file formats, and domain-specific correctness.
• Debug processing failures, dependencies, and numerical issues.
• Improve task reliability, reproducibility, and evaluation criteria.
• Document assumptions and technical decisions for reviewers.

Skills

Music/audio domain expertise

Linguistics/English literature

Task design translation

Education

Bachelor's degree from top 100 in country

Tools

Terminal-Bench 3.0

Job description

Experience: 6+ Years of Relevant Professional Media, Music, Linguistics, or Audio Experience

Job Type: Contractor

Location: Remote

Required Profiles: LinkedIn profile required to apply

Role Overview

We are looking for experienced professionals in music, audio processing, speech technology, and computational linguistics to develop and review terminal-based tasks for AI agent evaluation. You'll use your domain expertise to create realistic workflows, validate outputs, and ensure that tasks reflect practical professional or research activities.

Important: Prior hands-on experience working on Terminal-Bench 3.0 projects is mandatory.

Key Responsibilities

• Design multi-step tasks based on realistic media, music, speech, or linguistic workflows.
• Prepare input datasets, audio samples, linguistic data, and processing configurations.
• Configure reproducible computational environments and relevant domain-specific tools.
• Implement reference solutions and objective validation tests.
• Review output accuracy, file formats, and domain-specific correctness.
• Debug processing failures, dependencies, and numerical issues.
• Improve task reliability, reproducibility, and evaluation criteria.
• Document assumptions and technical decisions for reviewers.

Key Requirements

• Bachelor's degree from a university ranked among the top 100 institutions in the country.
• Minimum 6 years of relevant professional experience.
• Prior hands-on experience with Terminal-Bench 3.0 projects.
• Relevant background in Music, Linguistics, Computational Linguistics, or English Literature.
• Practical expertise in at least one relevant media or language specialization.
• Ability to translate domain workflows into testable tasks.
• Comfortable discussing technical or domain-specific workflows in an interview.
• Availability to work remotely on a flexible schedule.

Preferred Technical Skills

• Audio processing and digital signal processing.
• Speech technology, NLP, and computational linguistics.
• Music composition, performance, or conducting workflows.
• Scripting and command-line tools relevant to the specialization.
• Automated evaluation, benchmark development, or reproducible research.