Quality Assurance Engineer II

AgreeYa Solutions; Mercer Island (WA); Hybrid; USD 90,000 - 120,000; Full time

Job summary

AgreeYa Solutions seeks a Quality Assurance Engineer II to own the QA process on the Developer Experiences team on Mercer Island, WA, with a hybrid work model. You will partner with engineers, producers, and PMs to deliver tooling that improves player experiences globally.

Requirements include 3+ years in Software QA, with experience designing test plans, managing defect data, and reporting test coverage. ISTQB/ICAgile certifications are preferred and collaboration with creators is valued.

Qualifications

• Experience designing and executing test plans.
• Experience managing components of a defect database.
• Experience tasking remote testers and providing feedback on effectiveness.
• Experience embedded with developers and content creators.
• Experience creating custom reports on test coverage and defect data.

Responsibilities

• Execute and own quality activities including test planning, execution, and risk assessment.
• Diagnose crashes and defects through analysis of stack traces, logs, and runtime signals.
• Perform root cause analysis to explain why failures occur.
• Investigate complex issues via forensic analysis of execution paths and regressions.
• Interpret observability data to understand system behavior and gaps in logging.
• Attribute issues to codebase, service, or tooling with clear recommendations.
• Identify opportunities to improve development processes and product quality.
• Evolve QA practices and tools to increase efficiency and impact.
• Operate independently with planning, execution, and follow-through.

Skills

Test plan design

Defect data management

Remote tester management

Developer collaboration

Test coverage reporting

Education

ISTQB Foundation Level

ISTQB Agile Tester

ICAgile ICP-TST

ISTQB Expert Level

ISTQB Advanced Test Manager

Tools

Jira

Creator Workflows

Advanced Sentry

AI Tooling

Job description

Job Title: Quality Assurance Engineer II

Location: Mercer Island, WA (hybrid)

Type: Long term contract

Job Description:

As a Quality Assurance Engineer on the Developer Experiences team, you will own and evolve the QA process for your team. You will partner closely with software engineers, producers, and project managers to deliver tools that enable Rioters to work more effectively, resulting in better experiences for Players around the world.

Responsibilities

• Execute and own quality activities, including test planning, test execution, coordination, defect management, and risk assessment, to ensure high-quality, efficient, and effective outcomes for your team and closely related teams. Specifically, you will:
• Diagnose crashes and defects through technical analysis of stack traces, logs, and runtime signals to identify failure points and impacted systems.
• Perform root cause analysis by synthesizing crash data, reproduction context, and system behavior to explain why failures occur.
• Investigate complex or recurring issues through forensic analysis of execution paths, regressions, and system boundaries.
• Interpret observability data to understand system behavior and identify gaps in logging or instrumentation that block diagnosis.
• Attribute issues to the correct codebase, service, or tooling surface using evidence, and clearly communicate findings and recommended next steps.
• Identify opportunities to improve development processes and product quality, and provide clear, actionable recommendations.
• Solve complex quality challenges by evolving best practices and introducing new approaches to risk identification and mitigation.
• Operate independently with minimal day-to-day direction, taking ownership of planning, execution, and follow-through of QA work.
• Continuously improve QA processes, tools, and practices to increase efficiency, effectiveness, and impact over time.

Required Qualifications

• Experience designing and executing test plans.
• Experience managing components of a defect database.
• Experience tasking remote testers and providing feedback on effectiveness.
• Experience working embedded with developers and content creators.
• Experience creating custom reports on test coverage and defect data.
• 3+ years Software Quality Assurance Experience, with success leading testing efforts on a team.

Desired Qualifications

• Development experience with Creator Workflows, Jira, Advanced Sentry, and AI Tooling
• Preferred Licenses/certifications:
• ISTQB Foundation Level
• ISTQB Agile Tester or ICAgile Agile Testing (ICP-TST)
• ISTQB Expert Level
• ISTQB Advanced Test Manager
• ICAgile Test Expert (ICE-AT)