MCP Software Evaluation Environment Author

ixolabs.ai

France

Hybride

EUR 7 800 - 22 000

Plein temps

Il y a 2 jours
Soyez parmi les premiers à postuler
Générateur de candidature

N’envoyez pas un CV générique — générez un CV et une lettre de motivation adaptés à ce poste précis.

Passez les filtres ATS

Avantages offerts par ce poste

Remote work opportunities
Flexible scheduling

Résumé du poste

IXO is seeking to engage specialists to evaluate coding benchmarks requiring an agent to discover and use MCP-connected information. You will contribute technical work, help the reasoning process be inspectable, identify substantive errors, and provide evidence-based assessments.

The role emphasizes building reproducible environments, implementing deterministic validation, and documenting important edge cases.

Qualifications

  • Proficiency in at least one of Rust, TypeScript, Go, Java, Python or C++, supported by algorithms/data structures, debugging and performance reasoning.
  • Ability to deliver maintainable features, refactor code and improve scalability; communicate technical details precisely.

Responsabilités

  • Design repository problems involving bugs, features, refactoring or optimization with real MCP server context.
  • Build reproducible environments and golden reference solutions, including necessary tool interactions.
  • Implement deterministic validation that measures software correctness and MCP use, and document edge cases.

Connaissances

Rust
TypeScript
Go
Java
Python
C++
Algorithms
Debugging
Performance

Description du poste

IXO is engaging specialists to evaluate coding benchmarks that require an agent to discover and use MCP-connected information. Your contribution is technical work: make the reasoning inspectable, identify substantive errors and provide evidence that supports a reliable assessment.

Work you will do
  • Design repository problems involving bugs, features, refactoring or optimization where relevant context comes from real MCP servers.
  • Build the reproducible environment and a golden reference solution, including the tool interactions needed to solve the task.
  • Implement deterministic validation that measures both software correctness and appropriate MCP use, and document the important edge cases.
Required background and routes
  • Proficiency in at least one of Rust, TypeScript, Go, Java, Python or C++, supported by algorithms/data structures, debugging and performance reasoning.
  • Deliver maintainable features, refactor code and improve scalability; communicate technical details precisely and collaborate across disciplines.
Preferred background
  • Large distributed repositories, rigorous code-review practice or familiarity with ML/AI systems; prior AI experience is optional.
Deliverables
  • Submit the completed technical artifact or assessment with its supporting evidence, explicit assumptions, reproducible checks where applicable, and concise reasons for each material judgment. Address review findings within the agreed scope.
Location and schedule
  • Remote assignments are scheduled by agreement, with no guaranteed weekly volume. Availability planning can include 15 hours per week depending on the track. IXO confirms the applicable timing before work.
Pay and working terms
  • Per completed task; fee agreed before work USD. Payment is for a completed task that meets the agreed acceptance criteria. The fee, task specification and revision requirements are agreed before work; an advertised time estimate does not determine payment. Applying does not guarantee an assignment. Use public, licensed or otherwise authorized material only; do not submit confidential employer information, personal data or restricted research.
Obtenez votre examen gratuit et confidentiel de votre CV.
ou faites glisser et déposez votre fichier ici.
Similar jobs

Postes similaires à comparer

Command-Line Engineering Environment Author
Command-Line Engineering Environment Author

ixolabs.ai • France

Hybride
EUR 52 000 - 78 000
Remote MCP Evaluation Engineer: Reproducible Tasks
Remote MCP Evaluation Engineer: Reproducible Tasks

ixolabs.ai • France

Sur place
EUR 7 800 - 22 000
Remote work opportunities
Flexible scheduling
Software Implementation Reasoning Reviewer
Software Implementation Reasoning Reviewer

ixolabs.ai • France

Hybride
EUR 66 000 - 126 000
Machine Learning Benchmark Task Designer
Machine Learning Benchmark Task Designer

ixolabs.ai • France

Hybride
EUR 72 000 - 168 000
C Repository Behavior Task Author
C Repository Behavior Task Author

ixolabs.ai • France

Hybride
EUR 10 000 - 17 000
Early-Career Software Reasoning Contributor
Early-Career Software Reasoning Contributor

ixolabs.ai • France

Hybride
EUR 66 000 - 78 000
Software Engineering Practice Evaluator
Software Engineering Practice Evaluator

ixolabs.ai • France

Hybride
EUR 305 000 - 347 000
AI Product Integration Assessment Engineer
AI Product Integration Assessment Engineer

ixolabs.ai • France

Hybride
EUR 90 000 - 144 000
Open-Source Change Evaluation Engineer
Open-Source Change Evaluation Engineer

ixolabs.ai • France

Hybride
EUR 126 000 - 156 000
Published ML Benchmark Researcher
Published ML Benchmark Researcher

ixolabs.ai • France

Hybride
EUR 180 000 - 192 000