We are looking for a QA Engineer to own quality assurance for an intelligent document extraction solution. This role will validate both the AI-driven extraction accuracy and the application integrations, ensuring the solution meets functional, compliance, and performance standards before production rollout.
Key Responsibilities
- Author, execute, and maintain functional, integration, and regression test cases covering all document types in scope
- Validate LLM extraction accuracy, verify field values, null handling, business rule logic, and conditional extraction rules against expected outputs
- Design and execute end-to-end integration test scenarios covering the full pipeline from document ingestion through AI processing to data persistence and downstream system integration
- Track, manage, and report defects; coordinate resolution with the development and AI architecture teams
- Validate PII data handling and ensure compliance with enterprise governance and security controls
- Perform regression testing after changes to prompts, field schemas, or model versions
- Support UAT with business stakeholders and operations teams
Required Skills & Experience
- 4-6 years of experience in software QA with exposure to AI or data pipeline testing
- Experience testing API-driven integrations and document processing workflows
- Familiarity with Azure services (Azure SQL, Power Automate) preferred
- Strong defect tracking and test management skills (Azure DevOps or equivalent)
- Ability to validate structured data outputs (JSON) against business rules and field schemas
- Experience in financial services or lending domain is a plus