An application made for this job — a tailored resume and cover letter that speak straight to the posting.
Ai2 Aim is seeking an Automation QA Engineer / Business Analyst for a part-time, remote role with a 6‑month contract. The position focuses on automation QA and AI testing while also supporting business analysis tasks.
You will design and execute automated tests for multiple modules, validate AI-enabled features, and collaborate with product teams in a remote setup. This role offers growth toward longer-term opportunities.
Job Description
Employment Type: Part-Time, Remote
Contract: Initial 6-month contract
Performance Review: 3-month performance review
Potential: Contract extension and/or conversion to Permanent Full-Time based on performance, business needs, and mutual agreement
We are looking for an experienced Automation QA Engineer / Business Analyst to join our technology team and support the quality assurance, testing, and continuous improvement of multiple business applications and modules. This is a hybrid role with a primary focus on Automation Quality Assurance. The successful candidate will be responsible for designing, developing, maintaining, and executing automated test scenarios across multiple modules, including applications that incorporate Artificial Intelligence (AI) components.
The role will also involve selected Business Analyst responsibilities, particularly in understanding business requirements, analyzing workflows, identifying functional gaps, preparing acceptance criteria, and translating business requirements into comprehensive test scenarios. The ideal candidate is someone who can think beyond simply identifying bugs—someone who can understand how the system is supposed to work, how users will interact with it, and how automation can be used to efficiently validate system quality at scale.
Design, develop, execute, and maintain automated test scripts and test suites for web-based applications and business modules.
Develop automated regression, functional, integration, smoke, and end-to-end testing scenarios.
Identify repetitive manual testing activities that can be converted into automated test cases.
Build and maintain a scalable automation testing framework.
Execute automated test suites across multiple environments and application releases.
Validate application functionality, workflows, integrations, data processing, and system responses.
Conduct API testing and integration testing where applicable.
Perform database and data validation using SQL or other appropriate tools.
Analyze test failures and determine whether the issue is related to application defects, test scripts, test data, configuration, integrations, or environment issues.
Document defects with clear reproduction steps, expected results, actual results, screenshots/logs, and supporting evidence.
Work closely with developers to identify root causes and verify fixes.
Perform regression testing following bug fixes and new feature releases.
Maintain automated test scripts as application functionality and requirements evolve.
The role will include testing applications and modules that incorporate AI-powered functionality.
Responsibilities may include:
Develop test scenarios for AI-assisted features and workflows.
Validate AI-generated outputs against defined business requirements and expected outcomes.
Test different prompts, inputs, edge cases, and user scenarios.
Evaluate consistency, accuracy, relevance, and completeness of AI-generated results.
Identify unexpected, misleading, incomplete, or inconsistent AI responses.
Test AI functionality following changes to prompts, models, workflows, or supporting data.
Validate that AI features properly interact with underlying business rules, workflows, data, and user permissions.
Assist in establishing appropriate acceptance criteria for AI-enabled functionality.
Identify potential risks associated with AI-generated outputs and elevate issues where appropriate.
While Automation QA is the primary focus, the successful candidate will also provide Business Analyst support to ensure that testing is aligned with actual business requirements.
Responsibilities include:
Review and analyze business and functional requirements.
Understand end-to-end business processes and system workflows.
Translate requirements into testable acceptance criteria.
Identify missing, unclear, or conflicting requirements.
Work with stakeholders, developers, and product teams to clarify expected system behavior.
Create process flows, use cases, user scenarios, and functional test scenarios where required.
Identify potential gaps between business requirements and system functionality.
Participate in requirement reviews, sprint planning, refinement sessions, and product discussions.
Provide QA and business analysis feedback during the design and development process.
Help ensure that new features are both technically functional and aligned with business requirements.
Develop test plans, test cases, test scenarios, and automation coverage plans.
Maintain traceability between requirements, test cases, automated scripts, and defects.
Establish appropriate testing coverage for new modules and enhancements.
Maintain QA documentation, testing standards, and automation documentation.
Prepare test execution reports and communicate testing results to stakeholders.
Monitor test coverage and identify areas requiring additional automation.
Work closely with Developers, Business Analysts, Product Managers, and other QA team members.
Participate in Agile/Scrum ceremonies and development discussions.
Provide recommendations to improve application quality, usability, and reliability.
Identify opportunities to improve testing efficiency through automation and AI-assisted testing.
Contribute to establishing QA standards, processes, and best practices.
Help build a culture of quality throughout the software development lifecycle.
Qualifications
Proven experience as an Automation QA Engineer, Software QA Engineer, SDET, Test Automation Engineer, or similar role.
Strong experience with automated testing tools and frameworks.
Experience developing and maintaining automated test scripts.
Experience with web application testing.
Experience with functional, regression, integration, and end-to-end testing.
Experience with API testing and/or database testing is an asset.
Strong analytical and problem-solving skills.
Ability to understand complex workflows and translate requirements into comprehensive test scenarios.
Experience working with Agile/Scrum development teams.
Strong defect identification, documentation, and root-cause analysis skills.
Experience with SQL and data validation is an asset.
Business Analysis experience is an asset.
Experience testing applications with AI/Generative AI components is highly desirable.
Experience using AI tools such as ChatGPT, Claude, Gemini, or similar tools for QA, test generation, analysis, or productivity is an asset.
We are looking for someone who:
Has a strong automation-first QA mindset.
Can independently design and execute comprehensive automated testing.
Is comfortable testing multiple applications and modules simultaneously.
Can understand both technical functionality and business requirements.
Has strong attention to detail and an investigative mindset.
Can identify issues that may not be immediately obvious from basic functional testing.
Is comfortable testing new and evolving technology, including AI-powered functionality.
Can work independently in a remote environment.
Communicates clearly with developers, business stakeholders, and management.
Is proactive in identifying testing gaps rather than waiting for issues to be reported.
Can balance speed of delivery with quality and risk management.
Is comfortable working in a startup environment where processes and systems are continuously evolving.
This is a remote, part-time position under an initial 6-month contract.
The position will undergo a formal performance review after approximately 3 months. Depending on performance, business requirements, availability, and mutual agreement, the contract may be:
Extended beyond the initial 6-month term; and/or
Converted to a Permanent Full-Time position.
The role is suitable for an experienced QA professional who is looking for a flexible part-time opportunity while having the potential to grow into a longer-term position.