A.I Trainer

Odixcity Consulting; España; Presencial; EUR 40.000 - 60.000; Jornada completa

Descripción de la vacante

Odixcity Consulting seeks an AI Trainer to support the development and refinement of AI systems through data annotation, evaluation, and performance analysis. The role focuses on training workflows, prompt design, and bias mitigation across diverse domains.

The ideal candidate has 2+ years in related fields, strong Python/JSON/API familiarity, and ability to balance technical and creative tasks within a global team. This remote position welcomes worldwide applicants.

Formación

• Minimum of 2 years of experience in a relevant field (e.g., Software Engineering, Computer Science).
• Familiarity with Python, JSON, or APIs is a plus. A willingness to learn internal tooling and understand basic machine learning concepts is required.
• Comfortable reading technical papers or documentation to understand how models are expected to behave and staying updated on AI safety research.
• Experience using data analysis or metrics to justify training decisions and measure the success of interventions on model performance.
• Ability to manage multiple concurrent projects, prioritize tasks effectively in a fast-paced environment, and meet tight deadlines.
• Willingness to shift focus between highly technical tasks and creative tasks as project needs evolve.

Responsabilidades

• Architect and manage end-to-end training workflows, including supervised fine-tuning (SFT), RLHF, and red-teaming exercises.
• Develop complex prompt templates and testing scenarios to evaluate model performance across domains (coding, creative writing, reasoning, multilingual tasks).
• Define and maintain rubrics for model output quality and analyze failures to identify root causes of bias, hallucination, or errors.
• Create high-quality golden datasets that set the standard for model behavior in your area of expertise.
• Guide and review the work of junior trainers and data annotators across the global team.
• Maintain detailed documentation of training methodologies, model behaviors, and iterative improvements for stakeholders and research teams.
• Collaborate with ML Engineers and Product Managers to translate research goals into training tasks for annotators.
• Identify barriers in training workflows and propose improvements to internal platforms or tools.
• Design strategies for generating high-quality synthetic data to strengthen training datasets.

Conocimientos

Python

JSON

APIs

Data analysis

ML concepts

Descripción del empleo

Job Title

A.I Trainer (LLM & Generative AI Specialist)

Location

Remote (Worldwide)

Job Summary

We are seeking a detail-oriented and analytical AI Trainer to support the development and improvement of artificial intelligence systems. The AI Trainer will be responsible for training, evaluating, and refining machine learning models by providing high-quality data annotation, feedback, and performance analysis.

Responsibilities

• Architect and manage end-to-end training workflows, including supervised fine-tuning (SFT), Reinforcement Learning from Human Feedback (RLHF), and red-teaming exercises.
• Develop complex prompt templates and testing scenarios to evaluate model performance across various domains (coding, creative writing, reasoning, multilingual tasks).
• Define and maintain rubrics for model output quality. Conduct in-depth analysis of model failures and edge cases to identify root causes of bias, hallucination, or logical errors.
• Create high quality “golden datasets” that set the standard for model behavior in your area of expertise.
• Guide and review the work of junior trainers and data annotators, ensuring consistency and high standards across the global team.
• Maintain detailed documentation of training methodologies, model behaviors, and iterative improvements for internal stakeholders and research teams.
• Work closely with Machine Learning Engineers and Product Managers to translate technical research goals into actionable training tasks for human annotators.
• Identify barriers in the training workflow and propose improvements to the internal platforms or tools used for data annotation and model evaluation.
• Design and implement strategies for generating high-quality synthetic data to argument training datasets and improve model robustness in niche scenarios.

Requirements

• Minimum of 2 years of experience in a relevant field (e.g., Software Engineering, Computer Science).
• Proven ability to dissect complex problems, identify patterns in data, and articulate abstract concepts clearly.
• Familiarity with Python, JSON, or APIs is a plus. A willingness to learn internal tooling and understand basic machine learning concepts is required.
• Comfortable reading technical papers or documentation to understand how models are expected to behave and staying updated on the latest A.I. safety research.
• Experience using data analysis or metrics to justify training decisions and measure the success of specific interventions on model performance.
• Ability to manage multiple concurrent projects, prioritize tasks effectively in a fast-paced environment, and meet tight deadlines.
• Willingness to shift focus between highly technical tasks (e.g., ranking code) and creative tasks (e.g., writing fiction) as project needs evolve.