Senior AI QA Engineer - AI Output Evaluation & Release

Delta Exchange; United States; Remote; USD 120.000 - 160.000; Vollzeit

Zusammenfassung

Delta Exchange seeks a Senior QA Engineer to ensure the quality of AI products, focusing on evaluation and testing of AI outputs. You will be responsible for maintaining quality assurance for AI products and managing release processes, with hands-on work in evaluating AI outputs and collaborating with engineering teams.

In this role you will build golden datasets, design scoring systems, and run evaluation cycles to ensure the reliability of AI models, while identifying failure modes and turning

Qualifikationen

• Candidates with experience in AI product quality assurance.

Aufgaben

• Maintain QA for AI products, focusing on evaluation of AI outputs.
• Manage release processes and ensure quality across deployments.
• Build golden datasets, design scoring systems, and run evaluations to ensure model reliability.
• Identify failure modes and translate findings into improvements with engineering.

Kenntnisse

AI QA

Python

Quality Assurance

Jobbeschreibung

Delta Exchange seeks a Senior QA Engineer to ensure the quality of AI products, focusing on evaluation and testing of AI outputs. You will be responsible for maintaining quality assurance for AI products and managing release processes, with hands-on work in evaluating AI outputs and collaborating with engineering teams.

In this role you will build golden datasets, design scoring systems, and run evaluation cycles to ensure the reliability of AI models, while identifying failure modes and turning