AI Quality Engineer - Test Automation & AI/ML Testing

Cognizant; Bridgewater (MA); On-site; USD 55,000 - 75,000; Full time

Benefits offered by this job

Medical/Dental/Vision/Life Insurance

Paid holidays plus Paid Time Off

401(k) plan and contributions

Long-term/Short-term Disability

Paid Parental Leave

Employee Stock Purchase Plan

Job summary

Cognizant is seeking a driven Quality Engineer to advance AI-driven testing within our Quality Engineering & Assurance practice. You will design and maintain test automation with Java and Python, perform API and database testing, and collaborate with product teams to ensure robust quality across features.

You’ll use CI/CD tools and JIRA, apply AI tooling like Copilot for scripts, and validate AI-powered systems including chatbots for intent and edge cases.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
• 0 – 1 years of professional experience in a Quality Assurance or Quality Engineering role.
• Hands-on experience developing and maintaining test automation scripts and frameworks using Java and Python.
• Basic understanding of the Software Testing Life Cycle (STLC) and practical experience working in an Agile/Scrum environment.
• A keen interest in or prior experience testing AI-powered applications, such as chatbots or other AI/ML-based systems.
• Hands-on experience with the Hybrid Automation frameworks.
• Familiarity with CI/CD concepts and tools (e.g., Jenkins, GitLab, GitHub Actions).
• Exposure to performance testing tools (e.g., JMeter, Gatling).
• Basic knowledge of cloud platforms (AWS, Azure, or GCP) and containerization (Docker)
• A passion for learning and staying up to date with the latest trends in AI and software testing.

Responsibilities

• Design, develop, and maintain test automation frameworks using Java and Python.
• Perform API testing: Understand API concepts, develop and execute functional tests, interpret Swagger YAML files, and validate endpoints using Postman or Rest Assured automation frameworks.
• Conduct database testing: Write and execute SQL queries to retrieve, update, and delete data, ensuring database integrity and reliability.
• Own quality for assigned features and components: Collaborate with product managers and developers on requirements analysis, create detailed test cases, execute comprehensive test suites (functional, integration, regression), and provide final quality sign-off.
• Track and report testing progress: Use tools such as JIRA, ADO, or ALM for defect logging and reporting, ensuring transparency of feature quality to the team and stakeholders. Also understanding of CI/CD concepts.
• Implement and execute test plans for AI/ML applications: Support QA activities and certify the quality of AI-powered systems, including hands-on testing of chatbots for intent recognition, conversational flow, response accuracy, and edge case handling.
• Leverage modern AI tools to enhance workflow: Utilize AI code assistants like GitHub Copilot to accelerate test script development and explore generative AI for tasks such as test data creation and bug report summarization.
• Ensure AI reliability and fairness: Execute test cases to identify issues related to bias, fairness, and model robustness, contributing to the overall trustworthiness of AI systems.
• Develop and maintain test automation scripts and frameworks using Java and Python.
• Have proficiency with test and defect management tools, particularly JIRA or any similar tools.

Skills

Java

Python

STLC

AI testing

Hybrid automation

CI/CD

Performance testing

AWS

Docker

AI trends

Education

Bachelor’s or Master’s degree in CS/Engineering

Tools

JIRA

Postman

Rest Assured

Swagger

GitHub Copilot

GitHub Actions

GitLab

Jenkins

Job description

Cognizant is seeking a driven Quality Engineer to advance AI-driven testing within our Quality Engineering & Assurance practice. You will design and maintain test automation with Java and Python, perform API and database testing, and collaborate with product teams to ensure robust quality across features.

You’ll use CI/CD tools and JIRA, apply AI tooling like Copilot for scripts, and validate AI-powered systems including chatbots for intent and edge cases.