Role & responsibilities
The QA Analyst / Tester will play a key role in ensuring the accuracy, performance, and reliability of AI-driven data solutions, reporting dashboards, and automation products. This role requires a balance of analytical thinking, structured testing, and technical understanding of AI and data systems.
Key Responsibilities
- 1. **Testing & UAT for AI Solutions**
- Develop and execute test plans, test cases, and validation scripts for AI-driven dashboards and reporting systems.
- Participate in user acceptance testing (UAT) cycles, document issues, and track closure with development teams.
- Validate prompt responses and AI outputs for consistency, relevance, and alignment with business logic.
- 2. **Data Quality Assurance**
- Validate data accuracy, transformations, and integrity across data pipelines (SQL, APIs, cloud sources).
- Ensure dashboard metrics align with underlying source data and business KPIs.
- Perform regression and sanity checks post data refresh or model updates.
- 3. **Automation & Process Optimization**
- Support test automation and data validation processes using Python, SQL, or low-code testing tools.
- Document repeatable QA workflows and assist in building QA automation frameworks for dashboards and agents.
- Provide insights to improve data quality, system reliability, and reporting consistency.
- 4. **Collaboration & Reporting**
- Work closely with project managers, BSA, and developers to ensure smooth QA handoffs.
- Communicate QA progress, risks, and dependencies proactively.
- Maintain detailed QA documentation and UAT feedback logs.
Required Skills & Experience
- - 25 years of experience in QA, preferably with data or AI-driven products.
- - Strong understanding of data validation, SQL querying, and dashboard testing (Power BI, Tableau, etc.).
- - Exposure to AI/ML-based products or chat/insight generation models (OpenAI, LangChain, etc.) preferred.
- - Experience with Jira, ClickUp, or similar tools for test case management and defect tracking.
- - Strong analytical, documentation, and communication skills.
Behavioral Competencies
- - Detail-oriented and methodical with strong problem-solving mindset.
- - Comfortable working in fast-paced agile environments.
- - Collaborative and proactive in cross-functional discussions.
- - Strong ownership and accountability for quality outcomes.