Quality Assurance Engineer

Revenue Management Solutions, LLC; Oklahoma City (OK); On-site; USD 70,000 - 100,000; Full time

Job summary

Revenue Management Solutions, LLC is seeking a Quality Assurance Engineer in Oklahoma City to design, build, and maintain automated test frameworks for modern web apps and AI-driven solutions. You will perform hands-on UI/API testing and validate non-deterministic outputs from ML models.

You will work with Docker-based test environments, integrate tests into CI/CD pipelines, and collaborate with Product, Software, and Data/ML engineers to improve coverage and release quality.

Qualifications

• Experience with modern web automation and end-to-end testing tools.
• Docker for containerized test environments.
• API testing and automation experience.
• SQL querying for test setup and verification.
• Familiar with AI/ML testing concepts.
• Experience with CI/CD pipelines (GitHub Actions, Azure DevOps, Jenkins).
• Strong Agile/Scrum experience.
• Strong communication and problem-solving skills.

Responsibilities

• Design, develop, and maintain automation frameworks for web apps and APIs.
• Integrate test suites into CI/CD pipelines.
• Create containerized test environments using Docker.
• Test AI/ML features, evaluate non-deterministic outputs.
• Develop strategies for AI output validation and performance.
• Collaborate with Product Owners, Software and Data/ML Engineers.
• Participate in code reviews of test scripts.
• Document defects and track quality metrics.

Skills

Agile methodology

Problem-solving

Communication

Education

Bachelor's degree preferred

Tools

Playwright

Cypress

Selenium

WebdriverIO

Docker

Postman

REST Assured

HTTP clients

SQL

PostgreSQL

SQL Server

MySQL

GitHub Actions

Azure DevOps

Jenkins

Job description

If you are unable to complete this application due to a disability, contact this employer to ask for an accommodation or an alternative application process.

Quality Assurance Engineer

Full Time Oklahoma City, OK, US

Job Description

The Quality Assurance (QA) Engineer plays a pivotal role in ensuring the quality, reliability, and performance of our web applications and AI-driven solutions. This role is responsible for designing, building, and maintaining automated test frameworks, conducting hands-on exploratory and UI/API testing, and validating non-deterministic outputs from machine learning models.

In addition to traditional QA practices, you will leverage modern containerization tools (such as Docker) to manage isolated test environments and utilize AI-assisted tools (such as Copilot, synthetic test data generators, and intelligent test execution platforms) to optimize testing workflows, improve test coverage, and accelerate release cycles.

Duties and Responsibilities

• Modern Web & API Automation:
• Design, develop, and maintain robust, scalable automation frameworks for modern single-page web applications (React, Angular, Vue) and microservices/REST APIs.
• Integrate automated test suites into CI/CD deployment pipelines (e.g., GitHub Actions, Azure DevOps, Jenkins) for continuous validation.
• Containerized Test Environments & Infrastructure:
• Spin up, manage, and tear down local and cloud-based test environments using Docker containers and container orchestration tools.
• Execute automated test suites inside containerized environments to ensure consistency across local, staging, and production-like setups.
• Develop test strategies to validate AI/ML features, large language model (LLM) outputs, and non-deterministic application behavior for accuracy, relevancy, latency, and edge cases.
• Monitor and measure AI output consistency, safety/bias guardrails, and system performance under varying prompt payloads.
• AI-Driven QA Optimization:
• Utilize AI-assisted development tools and intelligent QA platforms to generate test cases, synthesize realistic test data sets, and accelerate root-cause failure analysis.
• Cross-Functional Collaboration:
• Collaborate closely with Product Owners, Software Engineers, and Data/ML Engineers during Agile/Scrum sprints to refine requirements, acceptance criteria, and edge-case scenarios.
• Participate in code reviews for test automation scripts to ensure high code quality and maintainability.
• Quality Process & Defect Management:
• Identify, document, prioritize, and track defects using modern issue-tracking tools (e.g., Jira).
• Assist in setting QA standards, test metrics, and best practices across the engineering organization.

Qualifications

Core Technical Requirements

• Automation Frameworks: Hands-on experience with modern web automation and end-to-end testing tools (e.g., Playwright, Cypress, Selenium, or WebdriverIO).
• Containerization & DevOps: Solid practical knowledge of Docker (writing Dockerfiles, using Docker Compose) for spinning up containerized applications, databases, and automated testing nodes.
• API Testing: Proficiency in API testing and automation using tools like Postman, REST Assured, or HTTP clients.
• Database Querying: Proficiency with SQL (PostgreSQL, SQL Server, MySQL) and experience querying relational or document databases for test setup and verification.
  

AI & Emerging Tech Capabilities

• AI Feature Testing: Familiarity with concepts around evaluating AI/ML features, RAG architectures, prompt engineering testing, or heuristic evaluation metrics.
• AI Productivity Tools: Familiarity or experience using AI tools (e.g., GitHub Copilot, ChatGPT, Claude) to write test scripts, create mock data, or generate test scenarios
  

Professional & Interpersonal Skills

• Agile Methodology: Proven experience working in an Agile/Scrum environment.
• Problem-Solving: Exceptional analytical, critical thinking, and debugging skills with high attention to detail.
• Communication: Excellent written and verbal communication skills to articulate technical defects, risk assessments, and test coverage clearly to technical and non-technical stakeholders.

Education/Experience

A bachelor's degree is not required, but preferred. More than anything, RMS is looking for people who are passionate about technology who want to develop the skills to solve hard and important problems.

Environmental Conditions

Indoor climate-controlled environment. Moderate to quiet noise level

Physical requirements

While performing the duties of this Job, the employee is regularly required to communicate verbally and in the written form. The employee is physically required to utilize a laptop and other electronic devices effectively. The employee must lift and/or move up to 20 pounds (laptop computer, bag, and accessories). Specific vision abilities required by this job include close vision and distance vision.

All applicants are subject to drug screens and background checks per company policies.