QA Automation Engineer

Wyre Al; India; Hybrid; INR 1,400,000 - 2,200,000; Full time

Job summary

Wyre AI in India (Hyderabad/Bangalore) is seeking a QA Automation Engineer to own test automation across API and UI layers, with growing exposure to AI-driven workloads. You will collaborate with engineering to build reliable, scalable test suites that support rapid product iteration.

The role emphasizes designing test strategies, reducing flaky tests, and integrating tests into CI/CD. You will evaluate AI/LLM features, prompts, and non-deterministic outputs to ensure quality at scale.

Qualifications

• 4+ years in QA/SDET roles with hands-on automation ownership.
• Strong experience automating API testing (REST, auth flows, contract/schema validation).
• Proven Playwright experience for UI automation (or strong aptitude to ramp from Selenium/Cypress).
• Exposure to testing AI/ML features or LLM workloads, such as evaluating non-deterministic outputs or building eval harnesses.
• Experience with eval frameworks (e.g., promptfoo, DeepEval, Ragas, LangSmith) for systematic LLM/agent output evaluation.
• Comfortable with Git, CI/CD tools (GitHub Actions, Jenkins).
• Solid understanding of testing pyramids, test data management, and environment strategy.
• Good communication skills, with the ability to write clear bug reports and collaborate with engineers.

Responsibilities

• Design, build, and maintain automated test suites for REST/API testing (Postman, RestAssured, Playwright API testing, or similar).
• Build and maintain UI automation using Playwright (TypeScript/JavaScript or Python).
• Test AI/LLM-powered features, including prompt-response validation and non-deterministic outputs.
• Integrate automated tests into CI/CD pipelines.
• Design test strategies for new features and identify edge cases and coverage gaps.
• Debug flaky tests and maintain overall test infrastructure health.
• Collaborate with developers on testability and quality gates prior to release.
• Report and track defects with clear, reproducible steps.

Skills

QA Automation

API testing

Playwright/UI

AI/LLM testing

Eval frameworks

Git & CI/CD

Test strategy

Bug reporting

Tools

Postman

RestAssured

Playwright

GitHub Actions

Jenkins

Docker

Job description

Job Description - Quality Assurance / Test Automation

Location

India- Hyderabad/Bangalore (Remote with Hybrid flexibility)

Job Type

Full-Time

Level

Individual Contributor

Experience

4+ Years

About Us

We are Wyre AI – B2B Startup focused on revolutionizing preconstruction workflows using AI. Our team is composed of visionaries, researchers, and engineers dedicated to pushing the boundaries of AI to develop transformative solutions. Founded by a repeat founder who had previously built Pype and exited successfully to Autodesk. We are committed to using technology and innovation to disrupt the status quo and create the future.

About the Role

We are looking for a QA Automation Engineer to own test automation across our API and UI layers, with growing exposure to testing AI-driven workloads. You will work closely with engineering to build reliable, maintainable test suites that scale with the product.

Key Responsibilities

• Design, build, and maintain automated test suites for REST/API testing (Postman, RestAssured, Playwright API testing, or similar).
• Build and maintain UI automation using Playwright (TypeScript/JavaScript or Python).
• Test AI/LLM-powered features, including prompt-response validation, agentic workflows, and output consistency/regression checks.
• Integrate automated tests into CI/CD pipelines.
• Design test strategies for new features and identify edge cases and coverage gaps.
• Debug flaky tests and maintain overall test infrastructure health.
• Collaborate with developers on testability and quality gates prior to release.
• Report and track defects with clear, reproducible steps.

Required Skills & Qualifications

• 4+ years in QA/SDET roles with hands-on automation ownership.
• Strong experience automating API testing (REST, auth flows, contract/schema validation).
• Proven Playwright experience for UI automation (or strong aptitude to ramp quickly from Selenium/Cypress).
• Exposure to testing AI/ML features or LLM-based workloads, such as evaluating non-deterministic outputs or building eval harnesses.
• Experience with eval frameworks (e.g., promptfoo, DeepEval, Ragas, LangSmith, or similar) for systematic LLM/agent output evaluation.
• Comfortable with Git, CI/CD tools (GitHub Actions, Jenkins), and version-controlled test code.
• Solid understanding of testing pyramids, test data management, and environment strategy.
• Good communication skills, with the ability to write clear bug reports and collaborate directly with engineers.

Nice to Have

• Experience with dossier-based or spec-driven QA methodologies.
• Familiarity with performance/load testing.
• Exposure to containerized environments (Docker, ECS).

Beyond Technical Skills - What We're Looking For

We're building more than just software. We're building a team that thrives in a fast-paced, high-ownership environment.

Startup Readiness & Ownership

• Bias for action: You move quickly, experiment, and iterate toward measurable outcomes.
• Comfort with ambiguity: You can create structure where processes do not yet exist.
• Ownership mindset: You take responsibility for outcomes, not just assigned tasks.
• Resourcefulness: You find practical solutions and know when to leverage existing tools versus building new solutions.

Business & Product Thinking

• Quality mindset: You think beyond individual test cases and care about the overall reliability and user experience of the product.
• Product curiosity: You want to understand how features are expected to work so you can identify risks, edge cases, and gaps early.
• Strategic thinking: You can balance speed, test coverage, maintainability, and product quality as the platform scales.

Collaboration & Communication

• Comfortable working directly with engineering, product, and leadership teams.
• Able to explain quality risks and technical issues clearly to both technical and non-technical stakeholders.
• Strong written and verbal communication skills.
• Open to feedback and continuous improvement.

Growth Potential

• Fast learner who enjoys exploring new testing approaches and technologies.
• Excited by the opportunity to help build automation and quality practices from the ground up.
• Interested in growing with a fast-scaling AI company.

Why Join Wyre AI?

• Help shape the quality and reliability of AI-powered products transforming the construction industry.
• Own and build automation across API and UI layers as the product scales.
• Gain hands-on experience testing AI/LLM-powered features, agentic workflows, and non-deterministic outputs.
• Work closely with Engineering to influence test strategy, automation, testability, and quality gates from an early stage.
• Help build and improve automation infrastructure rather than simply maintaining established test suites.
• Work with modern technologies including Playwright, CI/CD pipelines, and LLM evaluation frameworks.
• Take meaningful ownership of product quality in a fast-growing AI startup.
• Collaborate with a team working across AI, construction technology, and cloud-native engineering.