Remote Data Science Methodology Specialist (Contractor)

OpenTrain AI, Inc.; United States; Remote; USD 83,000 - 138,000; Part time

Job summary

OpenTrain AI, Inc. seeks a remote, part-time contractor to evaluate large language model behavior in complex data pipelines. You will write structured test cases, assess model outputs, and help improve analytic methods.

The role focuses on scalable analysis, pipeline integration, and documenting edge cases with clear recommendations. Ideal candidates have strong written English, the ability to explain technical ideas clearly, and experience with AI training projects.

Qualifications

• Entry level experience preferred in data science or AI training fields.
• Experience integrating large language models into data pipelines is desirable.
• Familiarity with evaluation frameworks or benchmark design will help in this role.
• Experience teaching, mentoring, or providing technical leadership is a plus.

Responsibilities

• Map scaled-analysis and pipeline-integration scenarios to an established evaluation taxonomy.
• Write detailed cases covering automated triage, data enrichment, analysis at scale, and realistic failure modes.
• Evaluate and grade model responses for source handling, reasoning, limitations, and practical usefulness.
• Identify over-refusal that could block legitimate analysis or interrupt pipeline continuity.
• Document difficult edge cases and emerging concerns in analytic methodology.
• Give clear written and verbal recommendations to support iterative improvement.

Skills

Written English

Data science concepts

Evaluation benchmarking

Technical leadership

Education

Entry-level experience

Tools

LLM integration

Benchmark design

Job description

OpenTrain AI, Inc. seeks a remote, part-time contractor to evaluate large language model behavior in complex data pipelines. You will write structured test cases, assess model outputs, and help improve analytic methods.

The role focuses on scalable analysis, pipeline integration, and documenting edge cases with clear recommendations. Ideal candidates have strong written English, the ability to explain technical ideas clearly, and experience with AI training projects.