Remote AI QA Trainer: Evaluation & Safety Lead

Meridial

United States

Remoto

USD 8.300 - 90.000

Tempo integral

14 dias+

Receba uma resposta desta empresa empregadora

Seu currículo e carta de apresentação personalizados exatamente para o que estão contratando.

Passe pelos filtros ATS

Resumo da vaga

Aitrainergigs is seeking an AI QA trainer to shape the evaluation of large-scale language models. You will design test plans, run regression suites, and document failure modes to improve prompts, guardrails, and evaluation metrics. This role emphasizes model reliability, safety, and high-signal bug reporting.

You will collaborate on adversarial red-teaming, automation with Python/SQL, and dashboards to track quality deltas over time in a remote, contract setting.

Qualificações

  • Bachelor’s, master’s, or PhD in computer science, data science, computational linguistics, statistics, or related field ideal.

Responsabilidades

  • Converse with the model on real-world scenarios and evaluation prompts.
  • Verify factual accuracy and logical soundness of responses.

Conhecimentos

Model evaluation
LLM safety
Prompt robustness
Data quality assurance
Multilingual testing
Domain-specific testing
Grounding verification
Compliance checks
Adversarial red-teaming
Automation (Python/SQL)
Dashboarding

Formação

Bachelor’s/Master’s/PhD in CS or related field

Ferramentas

PyTest
OpenAI Evals
RAG evaluators
Weights & Biases (W&B)
Python
SQL

Descrição da vaga

Aitrainergigs is seeking an AI QA trainer to shape the evaluation of large-scale language models. You will design test plans, run regression suites, and document failure modes to improve prompts, guardrails, and evaluation metrics. This role emphasizes model reliability, safety, and high-signal bug reporting.

You will collaborate on adversarial red-teaming, automation with Python/SQL, and dashboards to track quality deltas over time in a remote, contract setting.

Obtenha sua revisão de currículo grátis e confidencial.

ou arraste e solte seu arquivo aqui.

Similar jobs

Vagas similares que valem a pena comparar

Remote AI QA Architect & Evaluation Lead
Remote AI QA Architect & Evaluation Lead

Meridial • EUA

Remoto
USD 8.300 - 90.000
Remote AI QA Trainer: LLM Evaluation & Reliability
Remote AI QA Trainer: LLM Evaluation & Reliability

Agency • EUA

Remoto
USD 8.300 - 90.000
Remote AI QA Trainer for Model Safety & Quality
Remote AI QA Trainer for Model Safety & Quality

agency • EUA

Remoto
USD 8.300 - 90.000
Remote contract
Flexible hourly rate
AI QA Trainer: LLM Evaluation & Safety Expert
AI QA Trainer: LLM Evaluation & Safety Expert

Agency • EUA

Remoto
USD 120.000 - 160.000
AI QA Trainer
AI QA Trainer

Meridial • EUA

Remoto
USD 8.300 - 90.000
Remote AI QA Trainer & Evaluation Expert
Remote AI QA Trainer & Evaluation Expert

Invisible Technologies Inc. • EUA

Remoto
USD 8.300 - 90.000
AI QA Trainer - LLM Evaluation - Freelance Project
AI QA Trainer - LLM Evaluation - Freelance Project

Meridial • EUA

Remoto
USD 8.265 - 89.544
Secure computer and high-speed internet required
AI QA Trainer - Freelance Project
AI QA Trainer - Freelance Project

agency • EUA

Remoto
USD 8.300 - 90.000
Remote contract
Flexible hourly rate
AI QA Trainer - LLM Evaluation
AI QA Trainer - LLM Evaluation

Meridial • EUA

Remoto
USD 8.300 - 90.000
AI QA Trainer - LLM Evaluation - Freelance Project
AI QA Trainer - LLM Evaluation - Freelance Project

Agency • EUA

Remoto
USD 8.300 - 90.000