Senior AI QA Tester — Remote, LLM & RAG Validation

SIRO Clinpharm Pvt. Ltd.; United States; À distance; USD 90 000 - 130 000; Plein temps

Résumé du poste

SIRO Clinpharm Pvt. Ltd. seeks an AI Tester to ensure QA for AI/ML web apps, with emphasis on performance, accuracy, security and regulatory compliance. The role covers prompt engineering, RAG validation and AI observability in a remote setup.

Responsibilities include designing tests, creating plans, collaborating across teams, and validating model quality and drift in GxP-regulated environments.

Qualifications

• Extensive QA/testing or validation experience in AI/ML systems.
• Solid understanding of LLMs, evaluation metrics and model drift.
• Experience in API testing, SQL/data validation and UI testing.
• Hands-on testing with GenAI/LLM, prompt engineering, and RAG validation.
• Knowledge of Responsible AI, bias, fairness and output reliability.
• Python or TypeScript for test automation.
• Experience analyzing logs with log aggregation and AI observability tools.
• Exposure to GxP-regulated environments in pharma/biotech.

Responsabilités

• Design and execute tests for AI/ML web apps, covering edge cases and prompts.
• Create test plans, strategies and detailed test cases.
• Use defect tracking and test management tools for testing activities.
• Collaborate with product, development, business and platform teams.
• Test AI chat features and standard UI components.
• Validate model quality, metrics, drift, and performance.
• Test RAG pipelines, retrieval accuracy and grounding.
• Conduct non-functional testing including performance and security.
• Support validation evidence, audit/compliance activities.
• Perform AI observability testing with logs and monitoring.

Connaissances

QA/testing

AI concepts & LLMs

API testing

SQL / Data validation

Test design

Python

TypeScript

AI observability

RAG validation

Hallucination testing

Responsible AI practices

GxP/pharma validation

Communication skills

Problem-solving

Outils

Log analysis tools

Test automation tooling

Description du poste

SIRO Clinpharm Pvt. Ltd. seeks an AI Tester to ensure QA for AI/ML web apps, with emphasis on performance, accuracy, security and regulatory compliance. The role covers prompt engineering, RAG validation and AI observability in a remote setup.

Responsibilities include designing tests, creating plans, collaborating across teams, and validating model quality and drift in GxP-regulated environments.