Test AI Interview ENG

Sutherland; Bogotá ciudad; Presencial; COP 46.872.000 - 80.352.000; Jornada completa

Descripción de la vacante

Sutherland in Bogotá, Colombia seeks a detail-oriented Test AI Interview professional to design, execute, and analyze tests for our AI-powered interview systems, ensuring accuracy, fairness, and reliability.

You will craft test cases, run manual and automated tests, identify biases, document defects, and collaborate with product and engineering teams to improve quality and user experience across the platform. Proficiency in English and NLP testing is required.

Formación

• Experience in quality assurance testing for software or AI systems.
• Knowledge of AI concepts and ML applications.
• Proficiency with test automation tools and frameworks.
• Experience testing NLP or conversational AI systems.
• Understanding of interview assessment methodologies.

Responsabilidades

• Design and develop test cases for AI interview systems with thorough coverage.
• Execute manual and automated testing to evaluate performance and reliability.
• Analyze AI responses to identify biases or errors.
• Document results, defects and recommendations clearly.
• Collaborate with development and product teams to resolve issues.
• Evaluate user experience and accessibility of interview platforms.
• Conduct regression testing after updates or fixes.
• Monitor key performance metrics related to system quality and interview accuracy.
• Stay updated with industry QA best practices.

Conocimientos

Quality assurance

AI testing

NLP testing

Automation tools

Interview assessment

Analytical skills

Documentation

Bug tracking

Agile testing

English proficiency

Herramientas

Test automation tools

Descripción del empleo

Company Description

About Sutherland:

Artificial Intelligence. Automation. Cloud engineering. Advanced analytics. For business leaders, these are key factors of success. For us, they’re our core expertise.

We work with iconic brands worldwide. We bring them a unique value proposition through market-leading technology and business process excellence.

We’ve created over 200 unique inventions under several patents across AI and other critical technologies. Leveraging our advanced products and platforms, we drive digital transformation, optimize critical business operations, reinvent experiences, and pioneer new solutions, all provided through a seamless “as a service” model.

For each company, we provide new keys for their businesses, the people they work with, and the customers they serve. We tailor proven and rapid formulas, to fit their unique DNA. We bring together human expertise and artificial intelligence to develop digital chemistry. This unlocks new possibilities, transformative outcomes and enduring relationships.

Sutherland

Unlocking digital performance. Delivering measurable results

Job Description

We are seeking a detail-oriented and analytical Test AI Interview professional to join our team in Bogotá, Colombia. In this role, you will be responsible for designing, executing, and analyzing comprehensive tests for our AI-powered interview systems. You will work to ensure that our interview platforms deliver accurate, fair, and reliable assessments while maintaining the highest standards of quality and performance. This position requires a methodical approach to identifying system vulnerabilities, evaluating user experience, and documenting findings with precision.

• Design and develop comprehensive test cases and scenarios for AI interview systems, ensuring thorough coverage of functionality and edge cases
• Execute manual and automated testing protocols to evaluate system performance, accuracy, and reliability
• Analyze AI responses and interview outcomes to identify inconsistencies, biases, or errors in the system
• Document test results, defects, and recommendations in a clear and organized manner using established quality assurance standards
• Collaborate with development and product teams to communicate findings and track resolution of identified issues
• Evaluate the user experience and interface of interview platforms to ensure usability and accessibility
• Conduct regression testing to verify that updates and fixes do not negatively impact existing functionality
• Monitor and report on key performance metrics related to system quality and interview accuracy
• Stay current with industry best practices in AI testing and quality assurance methodologies
• Participate in continuous improvement initiatives to enhance testing processes and efficiency

Qualifications

• Proven experience in quality assurance testing, with a focus on software or AI systems
• Strong knowledge of artificial intelligence and machine learning concepts and their applications
• Proficiency with test automation tools and frameworks
• Experience testing natural language processing (NLP) or conversational AI systems
• Solid understanding of interview assessment methodologies and evaluation criteria
• Excellent analytical and problem-solving skills with strong attention to detail
• Proficiency in documenting test cases, defects, and technical findings
• Experience with test management and bug tracking tools
• Strong organizational skills and ability to manage multiple testing initiatives simultaneously
• Excellent written and verbal communication skills in English
• Familiarity with agile development methodologies and testing practices
• Preferred: Experience with AI bias detection and fairness testing
• Preferred: Knowledge of statistical analysis and data interpretation
• Preferred: Experience in the recruitment technology or HR tech industry