Software & Data Science Expert

aitrainer; Deutschland; Vor Ort; EUR 30.000 - 50.000; Teilzeit

Zusammenfassung

Aitrainer is looking for a candidate to author complex tasks for AI model evaluation within the Technology domain. The role requires at least 15–20 hours of commitment per week.

The ideal candidate has over 3 years of experience in software engineering or data science, with a focus on creating precise evaluation tasks based on technical documentation. Responsibilities include engaging with complex requests and enabling accurate AI outputs.

Qualifikationen

• 3+ years of hands-on experience in software engineering or data science.
• Ability to create tasks for AI evaluation based on technical documentation.
• Experience with multi-step problem solving.

Aufgaben

• Author tasks that test AI's ability to reason over technical documentation.
• Follow precise instructions to produce accurate outputs.
• Engage in complex, multi-step requests grounded in real-world files.

Kenntnisse

Software engineering

Data science & analytics

Jobbeschreibung

We are building a benchmark dataset to evaluate AI models on professional document understanding and instruction following within the Technology domain.

Responsibilities

Tasks consist of complex, multi-step requests grounded in real-world workspace files (technical specs, architecture docs, API references, codebases), web search, and code execution — each paired with a clearly defined ground truth output and an objective evaluation rubric. You will be responsible for authoring tasks that test an AI's ability to reason over technical documentation, follow precise instructions, and produce accurate, well-structured outputs.

We expect a minimum commitment of 15–20 hours per week.

Qualifications

Ideal candidates have 3+ years of hands‑on experience in one or more of the following sub-domains:

• Software engineering
• Data science & analytics

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.