AI QA Engineer

Mployee.me; Delhi; On-site; INR 1,500,000 - 2,800,000; Full time

Job summary

Mployment.me in Delhi seeks an AI QA Engineer with 4–6 years of QA experience in AI/ML data-driven platforms. You will design and execute testing strategies for AI services, including validation, bias testing, and data quality assessment to ensure compliance with business requirements.

The role involves collaborating with data scientists and ML engineers, creating test plans, and implementing automated testing within CI/CD pipelines to ensure robust model performance and data integrity.

Qualifications

• B.Tech or MSc in CS/Data Science or related field.
• 4–6 years of QA experience for AI/ML data-driven platforms.
• Experience in functional, performance, and data validation testing of AI models.

Responsibilities

• Design testing strategies for AI services including functional, performance, and bias testing.
• Create test plans, cases, and regression suites for AI/ML apps and government use cases.
• Perform model validation testing and data quality assessment against business requirements.
• Conduct fairness testing, bias detection, and ethical AI compliance checks for government AI apps.
• Maintain defect logs across dev, staging, production environments.

Skills

Manual and Performance Testing

Python

pytest

Jira

Education

B.Tech / M.Sc. in Computer Science, Data Science, or related fields

Tools

Selenium

TestNG

Cypress

Jira

TestRail

Postman

Jenkins

Job description

Job Description

Designation: AI QA Engineer Educational Qualification:

• B.Tech / M.Sc. in Computer Science, Data Science, or related fields.
• Certification in Quality Assurance or Test Automation preferred. Experience:
• 4—6 years in quality assurance for ALML systems or data-driven platforms.
• Experience in functional, performance, and data validation testing of AI models.
• Familiarity with testing frameworks for NLP, CV, and data-centric applications. Key Responsibilities: 1.Design and execute comprehensive testing strategies for AI services including functional, performance, and bias testing. 2. Create detailed test plans, test cases, and regression testing suites specifically tailored for AI/'ML applications and government use cases. 3. Perform model validation testing, data quality assessment, and AI output accuracy verification against business requirements 4. Conduct fairness testing, bias detection, and ethical AI compliance validation for government AI applications 5. Maintain comprehensive logs of defects, issues, and resolution tracking across development,staging, and production environments 6. Collaborate with data scientists and ML engineers to establish testing protocols for model performance and reliability 7. Execute automated testing frameworks for continuous integration and deployment of AI services. 8. Validate AI service integration points, API functionality, and data pipeline integrity 9. Monitor production AI systems for performance degradation, accuracy drift, and compliance violations Technical Competencies:
• AI Testing: Model validation, bias detection, fairness testing, AI output verification, and responsible AI compliance testing
• Test Automation: Selenium, pytest, TestNG, Cypress for automated testing frameworks and continuous integration
• Programming Languages: Python for test scripting, SQL for data validation, basic understanding of R for statistical testing
• Testing Tools: Jira, TestRail, Postman for API testing, Jenkins for CI/CD testing pipelines
• Data Validation: Data quality testing, ETL testing, data pipeline validation, and database testing techniques
• Performance Testing: Load testing, stress testing, and performance monitoring for AI services and data processing systems
• Security Testing: Data privacy validation, access control testing, encryption verification, and compliance audit support
• Cloud Testing: AWS, Azure, GCP testing environments, cloud service validation, and multi- environment testing strategies
• API Testing: REST API testing, GraphQL testing, microservices testing, and integration testing methodologies

Required Skills

['Manual and Performance Testing', 'Python', 'pytest', 'Jira']

Additional Information

Use public JD while sourcing.