Senior Software and Systems Benchmark Specialist

ixolabs.ai; France; Hybride; EUR 126 000 - 216 000; Plein temps

Résumé du poste

ixolabs.ai seeks remote contractors to design substantial technical problems based on hands-on software and systems experience, and to develop reference solutions with clear grading rubrics for rigorous assessment.

You will evaluate model outputs and provide technical feedback supported by evidence, addressing assumptions and reproducible checks where applicable. Remote assignments are scheduled by agreement with IXO.

Qualifications

• 8–12 years of software/systems engineering experience with hands-on responsibility.
• Translate specialist engineering work into rigorous scenarios, reference solutions and structured assessments; work independently and document technical decisions clearly.

Responsabilités

• Design substantial technical problems based on current or recent hands-on software and systems experience.
• Develop reference solutions and grading rubrics that make correctness, engineering depth and trade-offs explicit.
• Evaluate model outputs and write clear technical feedback supported by the relevant implementation or architectural evidence.

Connaissances

Hands-on software experience

Systems engineering

Formation

Bachelor's degree in a relevant field

Description du poste

IXO is engaging specialists to evaluate senior software and systems scenarios with expert reference reasoning. Your contribution is technical work: make the reasoning inspectable, identify substantive errors and provide evidence that supports a reliable assessment.

Work you will do

• Design substantial technical problems based on current or recent hands-on software and systems experience.
• Develop reference solutions and grading rubrics that make correctness, engineering depth and trade-offs explicit.
• Evaluate model outputs and write clear technical feedback supported by the relevant implementation or architectural evidence.

Required background and routes

• A relevant bachelor's and eight to twelve years of software/systems engineering, with current or recent hands-on responsibility.
• Translate specialist engineering work into rigorous scenarios, reference solutions and structured assessments; work independently and document technical decisions clearly.

Preferred background

• A master's, substantive published or open-source work, recognized engineering output or experience reviewing and grading technical work.

Deliverables

Submit the completed technical artifact or assessment with its supporting evidence, explicit assumptions, reproducible checks where applicable, and concise reasons for each material judgment. Address review findings within the agreed scope.

Location and schedule

Remote assignments are scheduled by agreement, with no guaranteed weekly volume. IXO confirms the applicable timing before work.

Pay and working terms

$105 $180/hr USD. The agreed hourly rate, scope, schedule and acceptance criteria are confirmed before work starts. Applying does not guarantee an assignment. Use public, licensed or otherwise authorized material only; do not submit confidential employer information, personal data or restricted research.