AI Test Engineer

Xerox Philippines; Lapu-Lapu; Hybrid; PHP 600,000 - 1,000,000; Full time

Job summary

Xerox Philippines seeks an AI Test Engineer to ensure the quality, reliability, and performance of AI-driven applications. You will design testing strategies, validate AI models across scenarios, and collaborate with data scientists and developers to deliver responsible AI solutions.

Responsibilities include test plan creation, automation, defect analysis, and continuous improvement of testing tools and processes. Hybrid work setup with onsite onboarding in Cebu City.

Qualifications

• Bachelor's degree in Computer Science or related field.
• ISTQB or equivalent testing certification is an advantage.
• Experience designing and executing test plans for AI/ML products.
• Knowledge of Python/Java and testing frameworks.

Responsibilities

• Develop and execute test plans, cases, and automation for AI solutions.
• Validate model accuracy, robustness, fairness, and reliability.
• Perform performance and scalability testing on AI apps.
• Create real-world and synthetic test scenarios.
• Identify defects, biases, and risks in AI systems.
• Collaborate with data scientists and developers.
• Monitor AI systems in production and propose improvements.
• Ensure responsible AI and QA standards compliance.
• Document outcomes and provide actionable insights.
• Contribute to tool/process improvements.

Skills

Test design

Automation

AI/ML testing

Python/Java

Performance testing

Selenium

CI/CD

Cloud platforms

Education

Bachelor's degree in Computer Science

ISTQB certification

Agile certifications

Tools

Selenium

JUnit

pytest

TensorFlow

PyTorch

Scikit-learn

AWS

Azure

GCP

Job description

About Xerox Holdings Corporation

For more than 100 years, Xerox has continually redefined the workplace experience. Harnessing our leadership position in office and production print technology, we’ve expanded into software and services to sustainably power the hybrid workplace of today and tomorrow. Today, Xerox is continuing its legacy of innovation to deliver client-centric and digitally-driven technology solutions and meet the needs of today’s global, distributed workforce. From the office to industrial environments, our differentiated business and technology offerings and financial services are essential workplace technology solutions that drive success for our clients. At Xerox, we make work, work. Learn more about us at www.xerox.com.

About Xerox Holdings Corporation

For more than 100 years, Xerox has continually redefined the workplace experience. Harnessing our leadership position in office and production print technology, we’ve expanded into software and services to sustainably power the hybrid workplace of today and tomorrow. Today, Xerox is continuing its legacy of innovation to deliver client-centric and digitally-driven technology solutions and meet the needs of today’s global, distributed workforce. From the office to industrial environments, our differentiated business and technology offerings and financial services are essential workplace technology solutions that drive success for our clients. At Xerox, we make work, work. Learn more about us at www.xerox.com.

Role Summary:

The AI Test Engineer is responsible for ensuring the quality, reliability, accuracy, and performance of AI-driven applications and machine learning models. This role designs and executes testing strategies, validates AI systems across diverse scenarios, identifies risks and biases, and collaborates with cross-functional teams to deliver high-quality, responsible AI solutions.

Functional / Technical Competencies:

• Software Testing and Quality Assurance methodologies
• AI/ML model testing and validation
• Test case design and test automation
• Performance, scalability, and latency testing
• Python, Java, or similar programming languages
• Testing tools such as Selenium, JUnit, and pytest
• Machine Learning frameworks (TensorFlow, PyTorch, Scikit-learn)
• Data pipeline testing and model evaluation metrics
• Cloud platforms (AWS, Azure, GCP)
• CI/CD pipelines and automation practices
• AI ethics, bias detection, and explainability concepts
• Agile development methodologies

Key Responsibilities:

• Develop and execute test plans, test cases, and automation frameworks for AI solutions.
• Validate AI models for accuracy, robustness, fairness, and reliability.
• Perform performance and scalability testing on AI-powered applications.
• Create real-world and synthetic test scenarios.
• Identify defects, edge cases, biases, and risks within AI systems.
• Collaborate with data scientists, developers, QA teams, IT, and business stakeholders.
• Monitor AI systems in production and recommend improvements.
• Ensure compliance with responsible AI and quality standards.
• Document testing outcomes and providing actionable insights.
• Contribute to continuous improvement of testing tools and processes.

Key Outputs / Tangible Results:

• AI test plans and test cases
• Automated test scripts and testing datasets
• AI model validation and performance reports
• Defect and root cause analysis documentation
• Quality assurance metrics and testing reports
• Monitoring and improvement recommendations
• Enhanced testing frameworks and processes

Organizational Strategies & Objectives:

• Deliver reliable, scalable, and high-performing AI solutions.
• Promote responsible AI practices through comprehensive testing and validation.
• Improve quality assurance standards through automation and continuous improvement.
• Enable effective collaboration between technical and business teams.

Relevant Credentials:

• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.
• ISTQB certification is an advantage.
• Agile-related certifications or training are preferred but not required.

Must Haves:

• Minimum 2-3 years of software testing or quality assurance experience.
• Experience designing and executing test plans and test cases.
• Strong analytical, problem-solving, and debugging skills.
• Excellent verbal and written communication skills.
• Ability to work effectively in a cross-functional environment.

Nice to Haves:

• At least 1 year of AI testing experience.
• At least 1 year of cloud engineering experience.
• Experience testing machine learning models and AI applications.
• Exposure to MLOps, AI monitoring, and Responsible AI practices.
• ISTQB certification or Agile certifications.

Role Considerations:

• Hybrid work setup. First month requires full-time onsite work for onboarding and training.
• Work location: Lexmark Plaza 1, Cebu Business Park, Cebu City.