AI QA & Automation Engineer for LLM & API Testing

Cloud Hybrid Technologies, LLC; Austin (TX); On-site; USD 55,104 - 96,432; Full time

Job summary

Cloud Hybrid Technologies, LLC is looking for a QA & Automation Engineer in Austin, TX, to develop AI-aligned test suites, particularly for multi-agent workflows and APIs. This role involves test automation for LLM-driven features and optimizing test coverage through auto-generation.

Applicants should have hands-on experience with AI test automation, proficiency in API and E2E testing using tools such as Playwright and Cypress, and familiarity with agent reliability frameworks.

Hourly rate will be determined based on experience, and the duration of the contract is 12 months with a possibility of extension.

Qualifications

• Experience with test automation in AI/LLM systems, addressing issues like flakiness and non‑determinism.
• Proficiency in API and E2E testing with tools like Playwright, Cypress, and Pytest.
• Familiarity with agent reliability evaluation frameworks.

Responsibilities

• Develop AI-aligned test suites for multi-agent workflows and APIs.
• Automate regression and reliability tests for LLM-driven features.
• Work with Test Agent to optimize test coverage.

Skills

AI-aligned test suites

LLM system

ML model testing

API testing

E2E testing

Playwright

Cypress

Pytest

Job description

Cloud Hybrid Technologies, LLC is looking for a QA & Automation Engineer in Austin, TX, to develop AI-aligned test suites, particularly for multi-agent workflows and APIs. This role involves test automation for LLM-driven features and optimizing test coverage through auto-generation.

Applicants should have hands-on experience with AI test automation, proficiency in API and E2E testing using tools such as Playwright and Cypress, and familiarity with agent reliability frameworks.

Hourly rate will be determined based on experience, and the duration of the contract is 12 months with a possibility of extension.