- Build reproducible environments, prepare relevant data and dependencies, and implement reference solutions.
- Develop tests and evaluation criteria that reliably distinguish correct solutions from incomplete or flawed approaches.
- Run coding agents against tasks, investigate their failures, and refine the tasks based on observed behavior.
- Identify implementation errors, flawed assumptions, data leakage, and other issues that affect correctness.
- Document task requirements, solution reasoning, and verification steps clearly.
Position: Competitive Data Scientist
Type: Contract
Compensation: $60 $120/hour
Location: Remote
Commitment: 10-40 hrs/week
Role Responsibilities
- Build reproducible environments, prepare relevant data and dependencies, and implement reference solutions.
- Develop tests and evaluation criteria that reliably distinguish correct solutions from incomplete or flawed approaches.
- Run coding agents against tasks, investigate their failures, and refine the tasks based on observed behavior.
- Identify implementation errors, flawed assumptions, data leakage, and other issues that affect correctness.
- Document task requirements, solution reasoning, and verification steps clearly.
Requirements
- Demonstrated experience in data science, ML, quantitative modeling, or relevant research competitions.
- Strong problem-solving ability and a clear understanding of the methods you use.
- Practical programming ability sufficient to implement and verify your own solutions.
- Relevant competition platforms include Kaggle, DrivenData, Zindi, AIcrowd, Numerai, DataSource.ai, and CodaLab/Codabench.