QA Engineer for AI-Powered Apps | Automation & Playwright

Rootstrap; Buenos Aires; A distancia; ARS 900.000 - 1.300.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Certifications & Mentorship

Learning Bonus

Remote work flexibility

Office access: Buenos Aires, Montevide

Gym benefits

Counseling services

Lunch reimbursements

Onboarding kit

Prizes & celebrations

Descripción de la vacante

Rootstrap is seeking a Semi Senior QA Engineer to join our AI-focused testing pipeline. You will design and execute test plans for AI-powered applications, including non-deterministic systems such as LLMs and RAG tools, while collaborating with developers to detect and prevent defects.

The role emphasizes mobile testing, automation with Playwright, and evaluating AI outputs to improve product quality. Remote-friendly with office options in Buenos Aires and Montevideo.

Formación

• 3+ years of experience as a QA Engineer.
• Hands-on mobile testing experience required.
• Experience with test automation, preferably Playwright.
• Experience testing AI-powered applications or AI/LLM features.
• Strong English communication skills.

Responsabilidades

• Create detailed, comprehensive, and well-structured test plans and test cases.
• Review client needs and technical specifications with the development team to provide timely feedback.
• Estimate, prioritize, plan, and coordinate testing activities.
• Identify, record, document thoroughly, and track bugs.
• Design, develop, and execute automation scripts (including Playwright-based automation).
• Perform thorough regression testing when bugs are resolved.
• Track quality assurance metrics and reports.
• Design and maintain evaluation suites (evals) to validate AI-powered features and detect regressions in model behavior.
• Test non-deterministic AI systems, including LLM-based features, AI agents, and RAG applications, using qualitative and quantitative evaluation methods.
• Analyze AI outputs, identify failure patterns, and collaborate with engineers to improve system quality.
• Stay up to date with new testing tools, AI evaluation techniques, and quality assurance strategies while driving continuous improvement.
• Investigate the causes of software defects and collaborate with the development team to implement preventive solutions.
• Collaborate on internal initiatives.

Conocimientos

QA Engineer

Mobile testing

Automation

Playwright

AI testing

English proficiency

Educación

Bachelor's in Computer Science

Herramientas

Playwright

AI evaluation tools

CI/CD tools

Descripción del empleo

Rootstrap is seeking a Semi Senior QA Engineer to join our AI-focused testing pipeline. You will design and execute test plans for AI-powered applications, including non-deterministic systems such as LLMs and RAG tools, while collaborating with developers to detect and prevent defects.

The role emphasizes mobile testing, automation with Playwright, and evaluating AI outputs to improve product quality. Remote-friendly with office options in Buenos Aires and Montevideo.