AI QA Automation Lead — LLM & Web/Mobile Testing

Incedo Inc.

Charlotte (NC)

On-site

USD 120,000 - 170,000

Full time

38 hours ago

Be an early applicant

Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Incedo Inc. is seeking an experienced QA Automation Lead to join our team. You will lead automation testing initiatives for web and mobile applications, designing scalable frameworks and ensuring delivery of high-quality software.

The role requires strong Java expertise, Selenium, Playwright, and TestNG, plus hands-on AI/Generative AI testing, including model evaluation and prompt testing. You will collaborate across engineering, analytics, product, and QA to advance quality across the SDLC.

Qualifications

Bachelor’s degree in computer science, IT, engineering, or related field.
10–15 years in software QA and test automation.
Strong OOP concepts and hands-on Java experience.
Extensive Playwright and TestNG experience; POM.
SQL Server and database validation knowledge.
2+ years AI model evaluation or Generative AI testing experience.

Responsibilities

Lead end-to-end automation testing for web and mobile apps.
Design and maintain scalable automation frameworks.
Develop test plans, suites, scenarios, and test cases.
Plan AI/ML and Generative AI testing, including model evaluation.
Validate LLM prompts and responses against requirements.
Collaborate with Developers, Product Owners, BAs, and QA teams; promote Shift-Left testing.
Track defects using JIRA and verify fixes.