Remote AI Data Science Quality Assurance Specialist

agency; United States; Remote; USD 8,300 - 90,000; Full time

Benefits offered by this job

Remote contract work

Job summary

Agency seeks a data science QA specialist to assess AI-generated analyses. You will test language models across statistical, ML, and data engineering topics, and explain limitations in reasoning and conclusions.

You will document reproducible errors, describe how they arise, and provide actionable feedback on prompts and evaluation measures to improve model performance. This is a remote contract role with hourly pay according to experience.

Qualifications

• Master’s or doctoral degree preferred in data science, CS, or statistics.
• Experience with supervised and unsupervised learning, regression, feature engineering.
• Strong written communication and documentation skills.

Responsibilities

• Work through practical scenarios and conceptual questions in data science with the model.
• Check responses for factual accuracy, sound reasoning, and appropriate methods.
• Record reproducible examples of errors and describe how they occur.
• Offer feedback on prompts and evaluation measures to help improve model performance.
• Explain your reasoning clearly so findings can be understood and reviewed.

Skills

Machine learning

Statistical modeling

Data engineering

Data visualization

Natural language processing

Time series analysis

Deep learning

Algorithm development

Education

Master's or PhD in data science, computer science, statistics

Job description

Agency seeks a data science QA specialist to assess AI-generated analyses. You will test language models across statistical, ML, and data engineering topics, and explain limitations in reasoning and conclusions.

You will document reproducible errors, describe how they arise, and provide actionable feedback on prompts and evaluation measures to improve model performance. This is a remote contract role with hourly pay according to experience.