AI Tester at Denvor CO _Remote

Volto Consulting; Colorado; Remote; USD 90,000 - 130,000; Part time

Job summary

VOLTO Consulting in Denver, CO is seeking an AI Tester specializing in AI & Generative AI quality engineering for a contract role. You will design and execute tests for AI-driven features, validate outputs, and ensure safety, accuracy, and compliance before production release.

You will assess probabilistic behavior, drift, and model risks, collaborate with developers and data teams, and document defects with evidence and recommendations. Remote-friendly engagement.

Qualifications

• 4–10 years of testing, QA, or validation experience.
• Experience with AI-enabled or data-driven systems preferred.
• Bachelor's or Master's degree in CS, Engineering, Data Science, or related field.

Responsibilities

• Design and execute test scenarios for AI-driven features.
• Validate AI outputs against acceptance criteria and business rules.
• Test AI behavior across inputs, edge cases, and context handling.
• Identify hallucinations, bias risks, and ensure responsible AI usage.
• Collaborate with developers, data teams, and product owners.

Skills

QA practices

AI/ML basics

Probabilistic testing

Data analysis

Automation basics

API testing

Education

Bachelor's or Master’s in CS/Engineering/Data Science

Tools

Python scripting

Test management tools

Job description

AI Tester AI & Generative AI Quality Engineering

Denver, CO (Zip Code-80221)- REMOTE

Contract Role

We are seeking a detail oriented AI Tester to ensure the quality, reliability, safety, and correctness of AIenabled applications, including systems that use machine learning and generative AI. This role focuses on validating AI behavior, testing probabilistic outputs, and ensuring AI solutions meet functional, nonfunctional, and responsibleuse expectations before and after production release. The AI Tester works closely with developers, architects, and product teams to identify risks, validate outcomes, and continuously improve AI system quality.

Key Responsibilities

AI & Functional Testing

• Design and execute test scenarios for AIdriven application features.
• Validate AI outputs against functional expectations, business rules, and acceptance criteria.
• Test AI behavior across a wide range of inputs, including edge cases and ambiguous scenarios.

Generative AI Validation

• Accuracy and relevance
• Consistency and stability
• Safety and appropriateness
• Identify hallucinations, incorrect reasoning, and undesired outputs.
• Validate prompt behavior, context handling, and response variability.

Data & Model Testing

• Verify quality and coverage of test data used for AI validation.
• Test AI systems using structured and unstructured data inputs.
• Support validation of model performance metrics such as accuracy, precision, recall, or similar indicators.

Regression, Monitoring & Drift

• Perform regression testing to ensure AI behavior remains acceptable after updates.
• Support monitoring of AI behavior in productionlike environments.
• Identify model or output drift and raise risks when behavior changes beyond acceptable thresholds.

Responsible AI & Risk Validation

• Validate AI systems for fairness, explainability, and bias risks based on defined guidelines.
• Ensure outputs comply with security, privacy, and ethical usage expectations.
• Support humanintheloop review processes where required.

Collaboration & Reporting

• Collaborate with AI developers, data teams, and product owners during delivery cycles.
• Clearly document defects, risks, and test findings with evidence and recommendations.
• Contribute to continuous improvement of AI testing strategies and practices.

Required Technical Skills

Testing & Quality Engineering

• Strong foundation in software testing and quality assurance practices.
• Experience designing test cases, test scenarios, and validation criteria.
• Understanding of regression testing and defect lifecycle management.

AI & Machine Learning Understanding

• Working knowledge of AI and machinelearning concepts, including probabilistic behavior.
• Understanding of generative AI characteristics such as nondeterministic outputs and context sensitivity.

Ability To Reason About Acceptable Vs. Unacceptable AI Responses

Data & Analysis

• Ability to work with structured and unstructured test data.
• Strong analytical skills to evaluate patterns, anomalies, and inconsistencies in AI outputs.

Automation & Tooling (Preferred)

• Exposure to test automation concepts and scripting.
• Familiarity with API testing and basic data validation techniques.

Experience & Qualifications

• 4 10 years of experience in testing, quality engineering, or validation roles.
• Exposure to AIenabled or datadriven systems is strongly preferred.
• Bachelor s or Master s degree in Computer Science, Engineering, Data Science, or related field.