AI Data Scientist Model Evaluation

OpenTrain AI, Inc.; Deutschland; Teletrabalho; EUR 74 000 - 123 000; Tempo parcial

Resumo da oferta

OpenTrain AI, Inc. offers remote, part-time contractor work evaluating AI-generated analyses and model outputs. You will write reference solutions and prompts to improve AI systems, focusing on data science problems, statistical reasoning, and bias assessment.

The role requires 5+ years in data science, strong Python skills, and excellent English writing. Location flexibility includes Germany, India, and the United States.

Qualificações

• Bachelor's degree or higher in data science, CS, statistics, math or related field.
• 5+ years as a data scientist or in a closely related analytical role.
• Proficiency in English (C1 or higher) with ability to write clear quantitative explanations.

Responsabilidades

• Review AI-generated analysis, code, and model outputs.
• Write step-by-step reference solutions and explanations for complex data problems.
• Fact-check quantitative claims and identify statistical or methodological errors.
• Compare and rate AI responses based on correctness and reasoning.
• Create prompts and responses for AI training across varied topics.
• Test models for inaccuracies or bias and assess reliability across use cases.

Conhecimentos

Python

Pandas

NumPy

scikit-learn

SQL

Data visualization

Communication

Formação académica

Bachelor's degree or higher in data science or related quantitative field

Ferramentas

Git

Jupyter

Descrição da oferta de emprego

The Work

You will evaluate AI-generated analytical reasoning, code, and model outputs for accuracy, clarity, sound methods, and correct quantitative claims. You will also create reference answers and detailed prompts that help improve AI systems.

The work covers data science and machine learning problems, including statistical reasoning, model choices, reliability, and possible bias.

• Review AI-generated analysis, code, and model outputs.
• Write step-by-step reference solutions and clear explanations for complex data problems.
• Fact-check quantitative claims and identify statistical or methodological errors.
• Compare and rate multiple AI responses based on correctness and reasoning quality.
• Create prompts and responses for AI training across varied topics.
• Test models for inaccuracies or bias and assess their reliability across use cases.

What It Pays and Takes

This is remote, part-time contractor work. The structured experience level is entry level, and the role also lists substantial professional data science experience as a requirement.

• Pay: $60 to $100 per hour.
• Time: 20 or more hours per week.
• Location: Open to candidates in Germany, India, and the United States.
• Language: C1 or higher English proficiency, with the ability to write clear quantitative explanations.
• Education: Bachelor's degree or higher in data science, computer science, statistics, mathematics, or a closely related quantitative field.
• Experience: 5 or more years as a data scientist or in a closely related analytical role.
• Technical skills: Strong Python for data analysis and machine learning, including pandas, NumPy, and scikit-learn.
• Knowledge: Statistics, experimental design, applied probability, and machine learning model development, evaluation, and deployment.
• Data skills: Advanced SQL and experience working with large, complex datasets.
• Communication: Experience with data visualization tools or dashboards and presenting findings to stakeholders.
• Work style: Careful, systematic, and focused on quality, reproducibility, and evaluating reasoning steps.
• Helpful background: AI data training, annotation, AI-generated content review, model evaluation, research-oriented data science, or machine learning with business or product datasets.

About AI Training Work

AI training is the human work behind systems that learn from examples, including reviewing model answers, checking code, and rating reasoning. People with strong data science experience are needed to judge technical accuracy and create reliable examples for AI systems.