Remote Data Scientist: AI Evaluation & Experimental Design

The Ai Training Company; North Carolina; A distancia; USD 90.000 - 120.000; Jornada completa

Descripción de la vacante

The Ai Training Company seeksJunior Data Scientists, Quantitative Analysts, and ML researchers for a remote AI project focused on statistics, ML, experimentation, and rigorous quantitative reasoning. You will evaluate AI-generated solutions, identify flawed methodology, and develop reference solutions to improve model performance.

Candidates with backgrounds in data science, statistics, and ML research will work on prompts, datasets, and evaluation criteria.

Formación

• At least one year of professional experience in data science or a closely related field.
• At least part of that experience must have occurred within the past three years.
• Strong foundation in statistics, probability, and quantitative reasoning.
• Experience analyzing real-world datasets and interpreting results.
• Ability to identify flawed methodology and statistical errors.
• Working knowledge of Python, R, SQL, or comparable quantitative tools.
• Strong analytical and problem-solving skills.
• Ability to communicate technical and statistical concepts clearly in writing.
• Comfortable working independently in a remote environment.

Responsabilidades

• Evaluate AI-generated responses across data science, statistics, ML, experimentation, and quantitative analysis.
• Identify incorrect assumptions, statistical errors, flawed methodology, weak experimental design, and unsupported conclusions.
• Create challenging expert-level prompts based on realistic analytical and quantitative problems.
• Build or review datasets used to evaluate model performance.
• Develop reference solutions that demonstrate correct methodology and reasoning.
• Assess whether analytical approaches are statistically sound, reproducible, and appropriate for the problem.
• Review model reasoning related to experimentation, causal inference, forecasting, predictive modeling, and data interpretation.
• Evaluate code and analytical workflows when relevant.
• Provide structured technical feedback explaining why an approach is correct or incorrect.
• Help refine evaluation criteria and improve the difficulty and quality of quantitative tasks.

Conocimientos

Data science

Quantitative analysis

Statistics

Machine learning

Python

R

SQL

Analytical thinking

Educación

Bachelor's degree in a quantitative field

Herramientas

Jupyter

Git

Descripción del empleo

The Ai Training Company seeksJunior Data Scientists, Quantitative Analysts, and ML researchers for a remote AI project focused on statistics, ML, experimentation, and rigorous quantitative reasoning. You will evaluate AI-generated solutions, identify flawed methodology, and develop reference solutions to improve model performance.

Candidates with backgrounds in data science, statistics, and ML research will work on prompts, datasets, and evaluation criteria.