Quality Assurance Engineer

ArbiterSports; United States; On-site; USD 85,000 - 125,000; Full time

Job summary

ArbiterSports is seeking a curious, analytical QA Engineer to leverage AI-powered testing throughout the development lifecycle, refining requirements and validating complex data-driven scenarios.

You will test REST and SOAP APIs, automate tests with Playwright/Selenium, and collaborate with Product, Engineering, and Support in agile ceremonies, applying critical thinking to AI outputs and ensuring high-quality software.

Qualifications

• Strong ability to analyze data, workflows, and system interactions, and to challenge requirements to clarify business rules and acceptance criteria.
• Strong test planning, risk analysis, test design, and execution skills.
• Experience automating tests for web-based and distributed systems using Playwright, Selenium, or similar frameworks, within standard development environments (e.g., VS Code, IntelliJ).
• Experience testing REST and SOAP APIs using tools such as Postman, SOAPUI, or equivalent platforms.
• Experience using AI-powered tools – understanding their strengths, limitations, and risks – to support testing, automation, debugging, analysis, and documentation, and to identify opportunities that improve efficiency and quality.
• Strong critical thinking and engineering judgment to prompt, validate, and refine AI-generated outputs.
• Highly organized, self-directed, and able to manage multiple priorities in a fast-paced environment.
• Excellent written and verbal communication skills.
• 3+ years of QA or Quality Engineering experience in an agile development environment.

Responsibilities

• Participate in refinement and planning sessions to identify risks, gaps, and edge cases early, and analyze system and data workflows to determine testing priorities and approach.
• Using AI tools to accelerate testing and analysis; create, maintain, and execute test plans, strategies, cases, and automation scripts; validate functionality across software and hardware solutions.
• Critically evaluate, validate, and refine AI-generated outputs to ensure accuracy, completeness, and business relevance.
• Perform functional, integration, regression, exploratory, and data-focused testing across applications and services.
• Test REST and SOAP APIs, validating JSON and XML responses.
• Investigate defects through root cause and data analysis, track resolution, and communicate quality risks and testing estimates, in collaboration with Product, Engineering, and Support stakeholders.
• Document test scenarios, results, and findings clearly and concisely.
• Contribute to improvement initiatives by identifying opportunities to enhance quality, efficiency, and AI-enabled workflows.
• Participate in agile ceremonies including standups, retrospectives, planning, and refinement activities.

Skills

Data analysis

Test planning

Test design

Test execution

Automation testing

Playwright

Selenium

REST APIs

SOAP APIs

Postman

SOAPUI

AI tools usage

Critical thinking

Communication

Agile

Tools

Playwright

Selenium

Postman

SOAPUI

Job description

We are seeking a curious, analytical, and continuously learning Quality Assurance Engineer. In this role, you will leverage AI powered tools to contribute throughout the development lifecycle, engaging in refinements, challenging requirements, and validating complex, data-driven scenarios.

You will treat AI as a force multiplier, using it to improve testing efficiency, automation, and analysis, while applying the critical thinking and human judgment needed to validate AI outputs and deliver consistently high-quality software.

Essential Job Functions

• Participate in refinement and planning sessions to identify risks, gaps, and edge cases early, and analyze system and data workflows to determine testing priorities and approach.
• Using AI tools to accelerate testing and analysis; create, maintain, and execute test plans, strategies, cases, and automation scripts; validate functionality across software and hardware solutions.
• Critically evaluate, validate, and refine AI-generated outputs to ensure accuracy, completeness, and business relevance.
• Perform functional, integration, regression, exploratory, and data-focused testing across applications and services.
• Test REST and SOAP APIs, validating JSON and XML responses.
• Investigate defects through root cause and data analysis, track resolution, and communicate quality risks and testing estimates, in collaboration with Product, Engineering, and Support stakeholders.
• Document test scenarios, results, and findings clearly and concisely.
• Contribute to improvement initiatives by identifying opportunities to enhance quality, efficiency, and AI-enabled workflows.
• Participate in agile ceremonies including standups, retrospectives, planning, and refinement activities.

Requirements

• Strong ability to analyze data, workflows, and system interactions, and to challenge requirements to clarify business rules and acceptance criteria.
• Strong test planning, risk analysis, test design, and execution skills.
• Experience automating tests for web-based and distributed systems using Playwright, Selenium, or similar frameworks, within standard development environments (e.g., VS Code, IntelliJ).
• Experience testing REST and SOAP APIs using tools such as Postman, SOAPUI, or equivalent platforms.
• Experience using AI-powered tools – understanding their strengths, limitations, and risks – to support testing, automation, debugging, analysis, and documentation, and to identify opportunities that improve efficiency and quality.
• Strong critical thinking and engineering judgment to prompt, validate, and refine AI-generated outputs.
• Highly organized, self-directed, and able to manage multiple priorities in a fast-paced environment.
• Excellent written and verbal communication skills.
• 3+ years of QA or Quality Engineering experience in an agile development environment.
• Cellphone or personal device to receive MFA (multi-factor authentication) texts or calls.
• Have an internet connection that’s adequate for their job, a minimum of 10Mbps down.

AI Usage & Candidate Authenticity:

AI tools may be used for resume formatting or drafting application materials; however, submitting content that misrepresents your experience, including copied job descriptions or unverifiable work history, is not acceptable. Candidates must be prepared to clearly and confidently speak to all experience listed. Arbiter may request work samples, portfolio links, or other forms of validation during the process. Use of AI tools during interviews or assessments, unless explicitly permitted, will result in disqualification. All offers are contingent upon successful completion of a pre-employment background check, including employment and education verification.