Senior AI Testing & Automation Engineer

Vena Solutions; United States; Remote; USD 82,000 - 111,000; Full time

Job summary

Vena Solutions is seeking a Senior Software Developer in Test to lead automated testing across AI-powered products. You will design and execute UI and API test suites, build scalable automation frameworks, and collaborate with engineering and product teams to improve quality and reliability.

You will apply AI testing techniques, validate model outputs, and integrate tests with CI/CD pipelines. Strong experience with Playwright, Rest-Assured, and modern QA practices is required.

Qualifications

• 5+ years’ experience in QA/QE and test automation roles in a fast-paced Agile environment.
• AI Testing Expertise: Proven track record testing AI/ML products (prompt evaluation, bias detection, or model boundary testing).
• Hands-on experience integrating AI tools or LLM APIs into CI/CD pipelines to accelerate test execution and detect flaky tests.
• Strong understanding of software testing methodologies, automation design patterns, and fundamentals of high-quality test case development.
• 3+ years of hands-on experience with at least one automation framework for both UI and API test automation (Playwright, Cypress, Selenium, RestAssured, RestSharp, Pytest).

Responsibilities

• Define test strategies from requirements to automation needs.
• Design, write, maintain, and manage automated UI and API test suites.
• Contribute to scalable automation frameworks (e.g., Playwright, Rest-Assured).
• Execute exploratory, functional, integration, performance, and regression tests.
• Collaborate with dev and product teams to validate testing requirements and optimize coverage.
• Champion best practices for automation, test data management, CI/CD integration, and code quality.
• Monitor and optimize automation pipelines for dependability and scalability.
• Perform root cause analysis and support teams in defect prevention.

Skills

QA/QE experience

AI testing

CI/CD integration

Test data management

Debugging

Tools

Playwright

Cypress

Selenium

RestAssured

RestSharp

Pytest

GitHub

GitLab

JIRA

Xray

Zephyr

Qase

Job description

Vena Solutions is seeking a Senior Software Developer in Test to lead automated testing across AI-powered products. You will design and execute UI and API test suites, build scalable automation frameworks, and collaborate with engineering and product teams to improve quality and reliability.

You will apply AI testing techniques, validate model outputs, and integrate tests with CI/CD pipelines. Strong experience with Playwright, Rest-Assured, and modern QA practices is required.